05-13 19:21:12 D/ModuleListener: ModuleListener.testStarted(com.google.android.assistant.v4.tvts.TvtsAssistant4Test#testNormalDeviceUsage) on SKBFXYZO0C1V
05-13 19:21:12 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:21:12 D/DeviceHostUtils: apiLevel: 31
05-13 19:21:12 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:21:12 D/DeviceHostUtils: apiLevel: 31
05-13 19:21:12 I/TvtsBaseAssistantTest: Running setup...
05-13 19:21:12 D/AppRunnerUtils: Running the following command: am start --es query Weather -p com.google.android.katniss -c android.intent.category.DEFAULT -a android.intent.action.ASSIST
05-13 19:21:12 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, start, --es, query, Weather, -p, com.google.android.katniss, -c, android.intent.category.DEFAULT, -a, android.intent.action.ASSIST] with timeout: 2m 0s
05-13 19:21:13 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:21:13 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:21:13 I/DeviceStateMonitor: Waiting 359959 ms for device SKBFXYZO0C1V package manager
05-13 19:21:13 I/NativeDeviceStateMonitor: Waiting 359893 ms for device SKBFXYZO0C1V external store
05-13 19:21:15 D/AppRunnerUtils: foregroundActivitySet(): [com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity]
05-13 19:21:16 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.google.android.apps.tvsearch.results.activity.SearchResultActivity.
05-13 19:21:16 D/AssistantTestUtils: Assistant successfully launched: true
05-13 19:21:16 D/TvtsBaseAssistantTest: Checking required services running...
05-13 19:21:16 D/RunUtil: Running command null without timeout.
05-13 19:21:16 D/AppRunnerUtils: Checking service: com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService
05-13 19:21:16 D/AppRunnerUtils: Running the following command: dumpsys activity service com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService
05-13 19:21:16 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, dumpsys, activity, service, com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService] with timeout: 2m 0s
05-13 19:21:16 I/AppRunnerUtils: Service PID = 3380
05-13 19:21:16 D/RunUtil: Running command null without timeout.
05-13 19:21:16 D/AppRunnerUtils: Checking service: com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService
05-13 19:21:16 D/AppRunnerUtils: Running the following command: dumpsys activity service com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService
05-13 19:21:16 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, dumpsys, activity, service, com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService] with timeout: 2m 0s
05-13 19:21:16 I/AppRunnerUtils: Service PID = 3380
05-13 19:21:16 D/TvtsBaseAssistantTest: Checking required processes running...
05-13 19:21:17 D/TvtsBaseAssistantTest: Enabling additional options...
05-13 19:21:17 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
05-13 19:21:17 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.katniss
05-13 19:21:17 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.katniss] with timeout: 2m 0s
05-13 19:21:17 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:21:17 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:21:18 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:21:18 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:21:18 D/RunUtil: Running command null without timeout.
05-13 19:21:18 D/AppRunnerUtils: Checking service: com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService
05-13 19:21:18 D/AppRunnerUtils: Running the following command: dumpsys activity service com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService
05-13 19:21:18 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, dumpsys, activity, service, com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService] with timeout: 2m 0s
05-13 19:21:18 I/AppRunnerUtils: Service PID = 4381
05-13 19:21:18 D/RunUtil: Running command null without timeout.
05-13 19:21:18 D/AppRunnerUtils: Checking service: com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService
05-13 19:21:18 D/AppRunnerUtils: Running the following command: dumpsys activity service com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService
05-13 19:21:18 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, dumpsys, activity, service, com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService] with timeout: 2m 0s
05-13 19:21:18 I/AppRunnerUtils: Service PID = 4381
05-13 19:21:18 I/AssistantTestUtils: Waiting for assistant to be ready...
05-13 19:21:18 D/AppRunnerUtils: Running the following command: am start --es query Weather -p com.google.android.katniss -c android.intent.category.DEFAULT -a android.intent.action.ASSIST
05-13 19:21:18 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, start, --es, query, Weather, -p, com.google.android.katniss, -c, android.intent.category.DEFAULT, -a, android.intent.action.ASSIST] with timeout: 2m 0s
05-13 19:21:19 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:21:19 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:21:19 I/DeviceStateMonitor: Waiting 359933 ms for device SKBFXYZO0C1V package manager
05-13 19:21:19 I/NativeDeviceStateMonitor: Waiting 359831 ms for device SKBFXYZO0C1V external store
05-13 19:21:21 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:21:22 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:21:22 D/AppRunnerUtils: Running the following command: am start --es query Weather -p com.google.android.katniss -c android.intent.category.DEFAULT -a android.intent.action.ASSIST
05-13 19:21:22 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, start, --es, query, Weather, -p, com.google.android.katniss, -c, android.intent.category.DEFAULT, -a, android.intent.action.ASSIST] with timeout: 2m 0s
05-13 19:21:22 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:21:22 I/NativeDeviceStateMonitor: Waiting 359999 ms for device SKBFXYZO0C1V boot complete
05-13 19:21:22 I/DeviceStateMonitor: Waiting 359958 ms for device SKBFXYZO0C1V package manager
05-13 19:21:22 I/NativeDeviceStateMonitor: Waiting 359891 ms for device SKBFXYZO0C1V external store
05-13 19:21:25 D/AppRunnerUtils: foregroundActivitySet(): [com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity]
05-13 19:21:25 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.google.android.apps.tvsearch.results.activity.SearchResultActivity.
05-13 19:21:25 D/AssistantTestUtils: Assistant successfully launched: true
05-13 19:21:26 D/RunUtil: Running command [logcat -d | grep -E 'AssistantWrapper(Impl)?: Assistant is now running.'] without timeout.
05-13 19:21:26 I/AssistantTestUtils: Assistant ready: true
05-13 19:21:26 D/AppRunnerUtils: Running the following command: am start --es query Weather -p com.google.android.katniss -c android.intent.category.DEFAULT -a android.intent.action.ASSIST
05-13 19:21:26 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, start, --es, query, Weather, -p, com.google.android.katniss, -c, android.intent.category.DEFAULT, -a, android.intent.action.ASSIST] with timeout: 2m 0s
05-13 19:21:27 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:21:27 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:21:27 I/DeviceStateMonitor: Waiting 359959 ms for device SKBFXYZO0C1V package manager
05-13 19:21:27 I/NativeDeviceStateMonitor: Waiting 359892 ms for device SKBFXYZO0C1V external store
05-13 19:21:29 D/AppRunnerUtils: foregroundActivitySet(): [com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity]
05-13 19:21:29 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.google.android.apps.tvsearch.results.activity.SearchResultActivity.
05-13 19:21:29 D/AssistantTestUtils: Assistant successfully launched: true
05-13 19:21:30 D/RunUtil: Running command null without timeout.
05-13 19:21:30 I/AssistantTestUtils: Checking if file pattern is present: /storage/emulated/0/Download/katniss-primes*
05-13 19:21:30 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, ls, -t, -d, /storage/emulated/0/Download/katniss-primes*] with timeout: 2m 0s
05-13 19:21:30 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, ls, -t, -d, /storage/emulated/0/Download/katniss-primes*] with timeout: 2m 0s
05-13 19:21:30 D/AssistantTestUtils: Session-based metrics File: /storage/emulated/0/Download/katniss-primes-2024-05-13T03_21_26.606.txt
05-13 19:21:30 D/NativeDevice: Using 'ls' to check doesFileExist(/storage/emulated/0/Download/katniss-primes-2024-05-13T03_21_26.606.txt)
05-13 19:21:30 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:21:30 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/2208ded8-50a5-4e77-9eb8-bbae18935fbe/tmp/katniss-primes-2024-05-13T03_21_26.606_8225335012752395538.txt] without timeout.
05-13 19:21:30 D/TvtsBaseAssistantTest: Metrics location: /storage/emulated/0/Download/katniss-primes-2024-05-13T03_21_26.606.txt
05-13 19:21:30 D/TvtsBaseAssistantTest: Option enabling successful!
05-13 19:21:30 I/KeyCodeUtils: Sending keyevent KEYCODE_BACK - intValue: 4
05-13 19:21:31 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:21:31 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:21:32 D/TvtsBaseAssistantTest: Running connectivity check...
05-13 19:21:32 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:21:32 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:21:32 I/DeviceStateMonitor: Waiting 359959 ms for device SKBFXYZO0C1V package manager
05-13 19:21:32 I/NativeDeviceStateMonitor: Waiting 359897 ms for device SKBFXYZO0C1V external store
05-13 19:21:34 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:21:34 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:21:34 I/DeviceStateMonitor: Waiting 359934 ms for device SKBFXYZO0C1V package manager
05-13 19:21:34 I/NativeDeviceStateMonitor: Waiting 359867 ms for device SKBFXYZO0C1V external store
05-13 19:21:36 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:21:36 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:21:36 I/DeviceStateMonitor: Waiting 359929 ms for device SKBFXYZO0C1V package manager
05-13 19:21:37 I/NativeDeviceStateMonitor: Waiting 359867 ms for device SKBFXYZO0C1V external store
05-13 19:21:39 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:21:39 I/NativeDeviceStateMonitor: Waiting 359999 ms for device SKBFXYZO0C1V boot complete
05-13 19:21:39 I/DeviceStateMonitor: Waiting 359959 ms for device SKBFXYZO0C1V package manager
05-13 19:21:39 I/NativeDeviceStateMonitor: Waiting 359898 ms for device SKBFXYZO0C1V external store
05-13 19:21:41 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:21:41 I/NativeDeviceStateMonitor: Waiting 359999 ms for device SKBFXYZO0C1V boot complete
05-13 19:21:41 I/DeviceStateMonitor: Waiting 359923 ms for device SKBFXYZO0C1V package manager
05-13 19:21:41 I/NativeDeviceStateMonitor: Waiting 359861 ms for device SKBFXYZO0C1V external store
05-13 19:21:43 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:21:43 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:21:43 I/DeviceStateMonitor: Waiting 359894 ms for device SKBFXYZO0C1V package manager
05-13 19:21:43 I/NativeDeviceStateMonitor: Waiting 359807 ms for device SKBFXYZO0C1V external store
05-13 19:21:45 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:21:45 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:21:45 I/DeviceStateMonitor: Waiting 359959 ms for device SKBFXYZO0C1V package manager
05-13 19:21:45 I/NativeDeviceStateMonitor: Waiting 359897 ms for device SKBFXYZO0C1V external store
05-13 19:21:47 D/AppRunnerUtils: Running the following command: am start --es query Weather -p com.google.android.katniss -c android.intent.category.DEFAULT -a android.intent.action.ASSIST
05-13 19:21:47 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, start, --es, query, Weather, -p, com.google.android.katniss, -c, android.intent.category.DEFAULT, -a, android.intent.action.ASSIST] with timeout: 2m 0s
05-13 19:21:47 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:21:47 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:21:48 I/DeviceStateMonitor: Waiting 359959 ms for device SKBFXYZO0C1V package manager
05-13 19:21:48 I/NativeDeviceStateMonitor: Waiting 359897 ms for device SKBFXYZO0C1V external store
05-13 19:21:50 D/AppRunnerUtils: foregroundActivitySet(): [com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity]
05-13 19:21:50 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.google.android.apps.tvsearch.results.activity.SearchResultActivity.
05-13 19:21:50 D/AssistantTestUtils: Assistant successfully launched: true
05-13 19:21:51 I/KeyCodeUtils: Sending keyevent KEYCODE_BACK - intValue: 4
05-13 19:21:51 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:21:52 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:21:52 D/AppRunnerUtils: Running the following command: am start --es query Weather -p com.google.android.katniss -c android.intent.category.DEFAULT -a android.intent.action.ASSIST
05-13 19:21:52 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, start, --es, query, Weather, -p, com.google.android.katniss, -c, android.intent.category.DEFAULT, -a, android.intent.action.ASSIST] with timeout: 2m 0s
05-13 19:21:53 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:21:53 I/NativeDeviceStateMonitor: Waiting 359999 ms for device SKBFXYZO0C1V boot complete
05-13 19:21:53 I/DeviceStateMonitor: Waiting 359958 ms for device SKBFXYZO0C1V package manager
05-13 19:21:53 I/NativeDeviceStateMonitor: Waiting 359891 ms for device SKBFXYZO0C1V external store
05-13 19:21:55 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, dumpsys, window, windows, --proto] with timeout: 2m 0s
05-13 19:21:55 D/AppRunnerUtils: com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity
05-13 19:21:55 D/AppRunnerUtils: Running the following command: am start --es query Weather -p com.google.android.katniss -c android.intent.category.DEFAULT -a android.intent.action.ASSIST
05-13 19:21:55 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, start, --es, query, Weather, -p, com.google.android.katniss, -c, android.intent.category.DEFAULT, -a, android.intent.action.ASSIST] with timeout: 2m 0s
05-13 19:21:56 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:21:56 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:21:56 I/DeviceStateMonitor: Waiting 359932 ms for device SKBFXYZO0C1V package manager
05-13 19:21:56 I/NativeDeviceStateMonitor: Waiting 359840 ms for device SKBFXYZO0C1V external store
05-13 19:21:58 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, dumpsys, window, windows, --proto] with timeout: 2m 0s
05-13 19:21:58 D/AppRunnerUtils: com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity
05-13 19:21:58 D/AppRunnerUtils: Running the following command: am start --es query Weather -p com.google.android.katniss -c android.intent.category.DEFAULT -a android.intent.action.ASSIST
05-13 19:21:58 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, start, --es, query, Weather, -p, com.google.android.katniss, -c, android.intent.category.DEFAULT, -a, android.intent.action.ASSIST] with timeout: 2m 0s
05-13 19:21:58 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:21:58 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:21:58 I/DeviceStateMonitor: Waiting 359929 ms for device SKBFXYZO0C1V package manager
05-13 19:21:59 I/NativeDeviceStateMonitor: Waiting 359837 ms for device SKBFXYZO0C1V external store
05-13 19:22:01 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, dumpsys, window, windows, --proto] with timeout: 2m 0s
05-13 19:22:01 D/AppRunnerUtils: com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity
05-13 19:22:01 D/AppRunnerUtils: Running the following command: am start --es query Weather -p com.google.android.katniss -c android.intent.category.DEFAULT -a android.intent.action.ASSIST
05-13 19:22:01 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, start, --es, query, Weather, -p, com.google.android.katniss, -c, android.intent.category.DEFAULT, -a, android.intent.action.ASSIST] with timeout: 2m 0s
05-13 19:22:01 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:22:01 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:22:01 I/DeviceStateMonitor: Waiting 359958 ms for device SKBFXYZO0C1V package manager
05-13 19:22:01 I/NativeDeviceStateMonitor: Waiting 359890 ms for device SKBFXYZO0C1V external store
05-13 19:22:03 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, dumpsys, window, windows, --proto] with timeout: 2m 0s
05-13 19:22:03 D/AppRunnerUtils: com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity
05-13 19:22:03 D/AppRunnerUtils: Running the following command: am start --es query Weather -p com.google.android.katniss -c android.intent.category.DEFAULT -a android.intent.action.ASSIST
05-13 19:22:03 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, start, --es, query, Weather, -p, com.google.android.katniss, -c, android.intent.category.DEFAULT, -a, android.intent.action.ASSIST] with timeout: 2m 0s
05-13 19:22:04 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:22:04 I/NativeDeviceStateMonitor: Waiting 359999 ms for device SKBFXYZO0C1V boot complete
05-13 19:22:04 I/DeviceStateMonitor: Waiting 359933 ms for device SKBFXYZO0C1V package manager
05-13 19:22:04 I/NativeDeviceStateMonitor: Waiting 359842 ms for device SKBFXYZO0C1V external store
05-13 19:22:06 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, dumpsys, window, windows, --proto] with timeout: 2m 0s
05-13 19:22:06 D/AppRunnerUtils: com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity
05-13 19:22:06 D/AppRunnerUtils: foregroundActivitySet(): [com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity]
05-13 19:22:07 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.google.android.apps.tvsearch.results.activity.SearchResultActivity.
05-13 19:22:07 D/AssistantTestUtils: Assistant setup not triggered after 5 retries. Current activity: com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity
05-13 19:22:07 D/TvtsBaseAssistantTest: OOBE skipping required: false
05-13 19:22:07 I/KeyCodeUtils: Sending keyevent KEYCODE_BACK - intValue: 4
05-13 19:22:07 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:22:08 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:22:08 I/KeyCodeUtils: Sending keyevent KEYCODE_BACK - intValue: 4
05-13 19:22:09 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:22:09 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:22:10 D/RunUtil: Running command null without timeout.
05-13 19:22:10 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:22:10 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:22:10 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:22:10 D/RunUtil: Running command null without timeout.
05-13 19:22:10 D/AppRunnerUtils: foregroundActivitySet(): [com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity]
05-13 19:22:10 I/KeyCodeUtils: Sending keyevent KEYCODE_HOME - intValue: 3
05-13 19:22:10 D/AppRunnerUtils: [com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity]
05-13 19:22:10 D/RunUtil: operation failed, waiting for 500 ms
05-13 19:22:10 D/RunUtil: Running command null without timeout.
05-13 19:22:10 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:22:11 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:22:11 D/AppRunnerUtils: Running the following command: am start --es query Weather -p com.google.android.katniss -c android.intent.category.DEFAULT -a android.intent.action.ASSIST
05-13 19:22:11 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, start, --es, query, Weather, -p, com.google.android.katniss, -c, android.intent.category.DEFAULT, -a, android.intent.action.ASSIST] with timeout: 2m 0s
05-13 19:22:11 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:22:11 I/NativeDeviceStateMonitor: Waiting 359999 ms for device SKBFXYZO0C1V boot complete
05-13 19:22:11 I/DeviceStateMonitor: Waiting 359958 ms for device SKBFXYZO0C1V package manager
05-13 19:22:11 I/NativeDeviceStateMonitor: Waiting 359892 ms for device SKBFXYZO0C1V external store
05-13 19:22:13 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, dumpsys, window, windows, --proto] with timeout: 2m 0s
05-13 19:22:13 D/AppRunnerUtils: com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity
05-13 19:22:13 D/AssistantTestUtils: AssistantSearchActivity: SearchResultActivity
05-13 19:22:13 D/AssistantTestUtils: Successfully triggered assistant search.
05-13 19:22:13 I/TvtsBaseAssistantTest: Test: HiTest
05-13 19:22:13 I/MeasurementPrinter: search-to-query	Measurement Status	query-to-result	Measurement Status	query-to-result-no-server-latency	Measurement Status
05-13 19:22:13 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:22:13 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:22:13 I/DeviceStateMonitor: Waiting 359939 ms for device SKBFXYZO0C1V package manager
05-13 19:22:13 I/NativeDeviceStateMonitor: Waiting 359847 ms for device SKBFXYZO0C1V external store
05-13 19:22:15 D/RunUtil: Running command null without timeout.
05-13 19:22:16 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:22:16 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:22:16 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:22:16 D/RunUtil: Running command null without timeout.
05-13 19:22:16 D/AppRunnerUtils: foregroundActivitySet(): [com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity]
05-13 19:22:16 I/KeyCodeUtils: Sending keyevent KEYCODE_HOME - intValue: 3
05-13 19:22:16 D/AppRunnerUtils: [com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity]
05-13 19:22:16 D/RunUtil: operation failed, waiting for 500 ms
05-13 19:22:16 D/RunUtil: Running command null without timeout.
05-13 19:22:16 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:22:16 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:22:16 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:22:17 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:22:17 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
05-13 19:22:17 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:22:17 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/2208ded8-50a5-4e77-9eb8-bbae18935fbe/tmp/katniss-primes-2024-05-13T03_21_26.606_17569407079836775301.txt] without timeout.
05-13 19:22:18 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
05-13 19:22:18 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
05-13 19:22:18 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
05-13 19:22:18 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HiTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
05-13 19:23:25 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:23:25 D/ProtoMeasurementBase: Begin Parse: search-to-query
05-13 19:23:25 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 319.000000
05-13 19:23:25 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 8.000000
05-13 19:23:25 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 315.000000
05-13 19:23:25 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 447.000000
05-13 19:23:25 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 521.000000
05-13 19:23:25 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
05-13 19:23:25 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1274.000000
05-13 19:23:25 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 58.000000
05-13 19:23:25 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 246.000000
05-13 19:23:25 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 27.000000
05-13 19:23:25 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 114.000000
05-13 19:23:25 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 14.000000
05-13 19:23:25 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 166.000000
05-13 19:23:25 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
05-13 19:23:25 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 89.000000
05-13 19:23:25 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
05-13 19:23:25 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 317.000000
05-13 19:23:25 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 139.000000
05-13 19:23:25 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 89.000000
05-13 19:23:25 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 414.000000
05-13 19:23:25 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1279.000000
05-13 19:23:25 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 44.000000
05-13 19:23:25 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 14.000000
05-13 19:23:25 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 562.000000
05-13 19:23:25 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 315.000000
05-13 19:23:25 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1018.000000
05-13 19:23:25 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 1830.000000
05-13 19:23:25 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 79.000000
05-13 19:23:25 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:23:25 D/ProtoMeasurementBase: Begin Parse: query-to-result
05-13 19:23:25 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 319.000000
05-13 19:23:25 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 8.000000
05-13 19:23:25 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 315.000000
05-13 19:23:25 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 447.000000
05-13 19:23:25 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 521.000000
05-13 19:23:25 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
05-13 19:23:25 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1274.000000
05-13 19:23:25 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 58.000000
05-13 19:23:25 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 246.000000
05-13 19:23:25 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 27.000000
05-13 19:23:25 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 114.000000
05-13 19:23:25 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 14.000000
05-13 19:23:25 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 166.000000
05-13 19:23:25 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 89.000000
05-13 19:23:25 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
05-13 19:23:25 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 317.000000
05-13 19:23:25 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 139.000000
05-13 19:23:25 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 89.000000
05-13 19:23:25 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 414.000000
05-13 19:23:25 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1279.000000
05-13 19:23:25 D/ProtoMeasurementBase: Adding required latency: query_recognized_to_result
05-13 19:23:25 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 44.000000
05-13 19:23:25 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 14.000000
05-13 19:23:25 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 562.000000
05-13 19:23:25 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 315.000000
05-13 19:23:25 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1018.000000
05-13 19:23:25 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 1830.000000
05-13 19:23:25 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 79.000000
05-13 19:23:25 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:23:25 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
05-13 19:23:25 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:23:25 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
05-13 19:23:25 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 319.000000
05-13 19:23:25 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 8.000000
05-13 19:23:25 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 315.000000
05-13 19:23:25 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 447.000000
05-13 19:23:25 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 521.000000
05-13 19:23:25 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
05-13 19:23:25 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1274.000000
05-13 19:23:25 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 58.000000
05-13 19:23:25 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 246.000000
05-13 19:23:25 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 27.000000
05-13 19:23:25 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 114.000000
05-13 19:23:25 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 14.000000
05-13 19:23:25 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 166.000000
05-13 19:23:25 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 89.000000
05-13 19:23:25 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
05-13 19:23:25 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 317.000000
05-13 19:23:25 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 139.000000
05-13 19:23:25 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 89.000000
05-13 19:23:25 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 414.000000
05-13 19:23:25 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1279.000000
05-13 19:23:25 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 44.000000
05-13 19:23:25 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 14.000000
05-13 19:23:25 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 562.000000
05-13 19:23:25 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 315.000000
05-13 19:23:25 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1018.000000
05-13 19:23:25 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 1830.000000
05-13 19:23:25 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 79.000000
05-13 19:23:25 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:23:25 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
05-13 19:23:25 I/MeasurementPrinter:           166.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
05-13 19:23:25 E/TvtsBaseAssistantTest: Run 1/20 encountered exception. See logs for details
05-13 19:23:25 E/TvtsBaseAssistantTest: HiTest failed: 
com.google.android.assistant.tvts.HiTest:
Error in testHiResponse(com.google.android.assistant.tvts.HiTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HiTest.testHiResponse(HiTest.java:33)


Time: 64.846
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HiTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HiTest.testHiResponse(HiTest.java:33)

FAILURES!!!
Tests run: 1,  Failures: 1



05-13 19:23:25 D/RunUtil: Running command null without timeout.
05-13 19:23:25 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:23:26 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:23:26 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:23:26 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:23:26 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:23:26 D/RunUtil: Running command null without timeout.
05-13 19:23:26 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:23:26 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:23:26 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:23:26 D/RunUtil: Running command null without timeout.
05-13 19:23:27 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:23:27 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:23:27 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:23:27 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:23:27 I/DeviceStateMonitor: Waiting 359964 ms for device SKBFXYZO0C1V package manager
05-13 19:23:27 I/NativeDeviceStateMonitor: Waiting 359898 ms for device SKBFXYZO0C1V external store
05-13 19:23:29 D/RunUtil: Running command null without timeout.
05-13 19:23:29 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:23:29 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:23:29 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:23:29 D/RunUtil: Running command null without timeout.
05-13 19:23:29 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:23:29 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:23:29 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:23:30 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:23:30 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
05-13 19:23:30 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:23:30 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/2208ded8-50a5-4e77-9eb8-bbae18935fbe/tmp/katniss-primes-2024-05-13T03_21_26.606_6252355605329000828.txt] without timeout.
05-13 19:23:30 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
05-13 19:23:30 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
05-13 19:23:30 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
05-13 19:23:30 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HiTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
05-13 19:24:37 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:24:37 D/ProtoMeasurementBase: Begin Parse: search-to-query
05-13 19:24:37 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 169.000000
05-13 19:24:37 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 51.000000
05-13 19:24:37 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 8.000000
05-13 19:24:37 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 163.000000
05-13 19:24:37 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 359.000000
05-13 19:24:37 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 414.000000
05-13 19:24:37 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1606.000000
05-13 19:24:37 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 164.000000
05-13 19:24:37 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 57.000000
05-13 19:24:37 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 206.000000
05-13 19:24:37 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 51.000000
05-13 19:24:37 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 31.000000
05-13 19:24:37 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 326.000000
05-13 19:24:37 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1597.000000
05-13 19:24:37 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 61.000000
05-13 19:24:37 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 370.000000
05-13 19:24:37 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 163.000000
05-13 19:24:37 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 4.000000
05-13 19:24:37 D/ProtoMeasurementBase: query_duration: size = 1, sum: 829.000000
05-13 19:24:37 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 1967.000000
05-13 19:24:37 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 138.000000
05-13 19:24:37 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
05-13 19:24:37 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:24:37 D/ProtoMeasurementBase: Begin Parse: query-to-result
05-13 19:24:37 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 169.000000
05-13 19:24:37 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 51.000000
05-13 19:24:37 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 8.000000
05-13 19:24:37 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 163.000000
05-13 19:24:37 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 359.000000
05-13 19:24:37 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 414.000000
05-13 19:24:37 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1606.000000
05-13 19:24:37 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 164.000000
05-13 19:24:37 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 57.000000
05-13 19:24:37 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 206.000000
05-13 19:24:37 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 51.000000
05-13 19:24:37 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 31.000000
05-13 19:24:37 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 326.000000
05-13 19:24:37 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1597.000000
05-13 19:24:37 D/ProtoMeasurementBase: Adding required latency: query_recognized_to_result
05-13 19:24:37 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 61.000000
05-13 19:24:37 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 370.000000
05-13 19:24:37 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 163.000000
05-13 19:24:37 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 4.000000
05-13 19:24:37 D/ProtoMeasurementBase: query_duration: size = 1, sum: 829.000000
05-13 19:24:37 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 1967.000000
05-13 19:24:37 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 138.000000
05-13 19:24:37 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:24:37 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
05-13 19:24:37 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:24:38 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
05-13 19:24:38 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 169.000000
05-13 19:24:38 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 51.000000
05-13 19:24:38 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 8.000000
05-13 19:24:38 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 163.000000
05-13 19:24:38 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 359.000000
05-13 19:24:38 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 414.000000
05-13 19:24:38 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1606.000000
05-13 19:24:38 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 164.000000
05-13 19:24:38 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 57.000000
05-13 19:24:38 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 206.000000
05-13 19:24:38 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 51.000000
05-13 19:24:38 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 31.000000
05-13 19:24:38 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 326.000000
05-13 19:24:38 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1597.000000
05-13 19:24:38 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 61.000000
05-13 19:24:38 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 370.000000
05-13 19:24:38 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 163.000000
05-13 19:24:38 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 4.000000
05-13 19:24:38 D/ProtoMeasurementBase: query_duration: size = 1, sum: 829.000000
05-13 19:24:38 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 1967.000000
05-13 19:24:38 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 138.000000
05-13 19:24:38 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:24:38 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
05-13 19:24:38 I/MeasurementPrinter:           138.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
05-13 19:24:38 E/TvtsBaseAssistantTest: Run 2/20 encountered exception. See logs for details
05-13 19:24:38 E/TvtsBaseAssistantTest: HiTest failed: 
com.google.android.assistant.tvts.HiTest:
Error in testHiResponse(com.google.android.assistant.tvts.HiTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HiTest.testHiResponse(HiTest.java:33)


Time: 64.859
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HiTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HiTest.testHiResponse(HiTest.java:33)

FAILURES!!!
Tests run: 1,  Failures: 1



05-13 19:24:38 D/RunUtil: Running command null without timeout.
05-13 19:24:38 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:24:38 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:24:38 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:24:38 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:24:39 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:24:39 D/RunUtil: Running command null without timeout.
05-13 19:24:39 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:24:39 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:24:39 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:24:39 D/RunUtil: Running command null without timeout.
05-13 19:24:39 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:24:39 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:24:39 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:24:39 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:24:39 I/DeviceStateMonitor: Waiting 359964 ms for device SKBFXYZO0C1V package manager
05-13 19:24:39 I/NativeDeviceStateMonitor: Waiting 359897 ms for device SKBFXYZO0C1V external store
05-13 19:24:41 D/RunUtil: Running command null without timeout.
05-13 19:24:41 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:24:41 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:24:41 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:24:41 D/RunUtil: Running command null without timeout.
05-13 19:24:41 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:24:41 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:24:41 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:24:42 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:24:42 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
05-13 19:24:42 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:24:42 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/2208ded8-50a5-4e77-9eb8-bbae18935fbe/tmp/katniss-primes-2024-05-13T03_21_26.606_7483268916540622381.txt] without timeout.
05-13 19:24:43 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
05-13 19:24:43 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
05-13 19:24:43 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
05-13 19:24:43 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HiTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
05-13 19:25:50 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:25:50 D/ProtoMeasurementBase: Begin Parse: search-to-query
05-13 19:25:50 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 240.000000
05-13 19:25:50 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 78.000000
05-13 19:25:50 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 14.000000
05-13 19:25:50 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 237.000000
05-13 19:25:50 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 343.000000
05-13 19:25:50 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 537.000000
05-13 19:25:50 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1215.000000
05-13 19:25:50 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 237.000000
05-13 19:25:50 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 9.000000
05-13 19:25:50 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 237.000000
05-13 19:25:50 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 77.000000
05-13 19:25:50 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 26.000000
05-13 19:25:50 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 431.000000
05-13 19:25:50 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1206.000000
05-13 19:25:50 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 71.000000
05-13 19:25:50 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 474.000000
05-13 19:25:50 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 237.000000
05-13 19:25:50 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 10.000000
05-13 19:25:50 D/ProtoMeasurementBase: query_duration: size = 1, sum: 979.000000
05-13 19:25:50 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 1681.000000
05-13 19:25:50 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 94.000000
05-13 19:25:50 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
05-13 19:25:50 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:25:50 D/ProtoMeasurementBase: Begin Parse: query-to-result
05-13 19:25:50 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 240.000000
05-13 19:25:50 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 78.000000
05-13 19:25:50 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 14.000000
05-13 19:25:50 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 237.000000
05-13 19:25:50 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 343.000000
05-13 19:25:50 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 537.000000
05-13 19:25:50 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1215.000000
05-13 19:25:50 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 237.000000
05-13 19:25:50 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 9.000000
05-13 19:25:50 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 237.000000
05-13 19:25:50 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 77.000000
05-13 19:25:50 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 26.000000
05-13 19:25:50 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 431.000000
05-13 19:25:50 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1206.000000
05-13 19:25:50 D/ProtoMeasurementBase: Adding required latency: query_recognized_to_result
05-13 19:25:50 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 71.000000
05-13 19:25:50 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 474.000000
05-13 19:25:50 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 237.000000
05-13 19:25:50 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 10.000000
05-13 19:25:50 D/ProtoMeasurementBase: query_duration: size = 1, sum: 979.000000
05-13 19:25:50 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 1681.000000
05-13 19:25:50 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 94.000000
05-13 19:25:50 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:25:50 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
05-13 19:25:50 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:25:50 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
05-13 19:25:50 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 240.000000
05-13 19:25:50 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 78.000000
05-13 19:25:50 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 14.000000
05-13 19:25:50 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 237.000000
05-13 19:25:50 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 343.000000
05-13 19:25:50 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 537.000000
05-13 19:25:50 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1215.000000
05-13 19:25:50 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 237.000000
05-13 19:25:50 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 9.000000
05-13 19:25:50 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 237.000000
05-13 19:25:50 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 77.000000
05-13 19:25:50 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 26.000000
05-13 19:25:50 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 431.000000
05-13 19:25:50 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1206.000000
05-13 19:25:50 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 71.000000
05-13 19:25:50 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 474.000000
05-13 19:25:50 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 237.000000
05-13 19:25:50 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 10.000000
05-13 19:25:50 D/ProtoMeasurementBase: query_duration: size = 1, sum: 979.000000
05-13 19:25:50 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 1681.000000
05-13 19:25:50 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 94.000000
05-13 19:25:50 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:25:50 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
05-13 19:25:50 I/MeasurementPrinter:            94.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
05-13 19:25:50 E/TvtsBaseAssistantTest: Run 3/20 encountered exception. See logs for details
05-13 19:25:50 E/TvtsBaseAssistantTest: HiTest failed: 
com.google.android.assistant.tvts.HiTest:
Error in testHiResponse(com.google.android.assistant.tvts.HiTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HiTest.testHiResponse(HiTest.java:33)


Time: 64.93
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HiTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HiTest.testHiResponse(HiTest.java:33)

FAILURES!!!
Tests run: 1,  Failures: 1



05-13 19:25:50 D/RunUtil: Running command null without timeout.
05-13 19:25:50 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:25:51 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:25:51 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:25:51 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:25:52 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:25:52 D/RunUtil: Running command null without timeout.
05-13 19:25:52 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:25:52 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:25:52 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:25:52 D/RunUtil: Running command null without timeout.
05-13 19:25:52 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:25:52 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:25:52 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:25:52 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:25:52 I/DeviceStateMonitor: Waiting 359964 ms for device SKBFXYZO0C1V package manager
05-13 19:25:52 I/NativeDeviceStateMonitor: Waiting 359897 ms for device SKBFXYZO0C1V external store
05-13 19:25:54 D/RunUtil: Running command null without timeout.
05-13 19:25:54 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:25:54 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:25:54 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:25:54 D/RunUtil: Running command null without timeout.
05-13 19:25:54 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:25:54 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:25:54 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:25:55 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:25:55 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
05-13 19:25:55 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:25:55 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/2208ded8-50a5-4e77-9eb8-bbae18935fbe/tmp/katniss-primes-2024-05-13T03_21_26.606_4354314291442964620.txt] without timeout.
05-13 19:25:55 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
05-13 19:25:55 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
05-13 19:25:55 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
05-13 19:25:55 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HiTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
05-13 19:27:02 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:27:03 D/ProtoMeasurementBase: Begin Parse: search-to-query
05-13 19:27:03 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 168.000000
05-13 19:27:03 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 55.000000
05-13 19:27:03 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 11.000000
05-13 19:27:03 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 167.000000
05-13 19:27:03 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 298.000000
05-13 19:27:03 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 536.000000
05-13 19:27:03 D/ProtoMeasurementBase: searchbar_state_loading: size = 1, sum: 2.000000
05-13 19:27:03 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 167.000000
05-13 19:27:03 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 6.000000
05-13 19:27:03 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 160.000000
05-13 19:27:03 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 55.000000
05-13 19:27:03 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 26.000000
05-13 19:27:03 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 433.000000
05-13 19:27:03 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1004.000000
05-13 19:27:03 D/ProtoMeasurementBase: searchbar_state_listening: size = 3, sum: 167.000000
05-13 19:27:03 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 328.000000
05-13 19:27:03 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 167.000000
05-13 19:27:03 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 5.000000
05-13 19:27:03 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1000.000000
05-13 19:27:03 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 1332.000000
05-13 19:27:03 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 76.000000
05-13 19:27:03 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
05-13 19:27:03 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:27:03 D/ProtoMeasurementBase: Begin Parse: query-to-result
05-13 19:27:03 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 168.000000
05-13 19:27:03 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 55.000000
05-13 19:27:03 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 11.000000
05-13 19:27:03 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 167.000000
05-13 19:27:03 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 298.000000
05-13 19:27:03 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 536.000000
05-13 19:27:03 D/ProtoMeasurementBase: searchbar_state_loading: size = 1, sum: 2.000000
05-13 19:27:03 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 167.000000
05-13 19:27:03 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 6.000000
05-13 19:27:03 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 160.000000
05-13 19:27:03 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 55.000000
05-13 19:27:03 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 26.000000
05-13 19:27:03 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 433.000000
05-13 19:27:03 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1004.000000
05-13 19:27:03 D/ProtoMeasurementBase: Adding required latency: query_recognized_to_result
05-13 19:27:03 D/ProtoMeasurementBase: searchbar_state_listening: size = 3, sum: 167.000000
05-13 19:27:03 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 328.000000
05-13 19:27:03 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 167.000000
05-13 19:27:03 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 5.000000
05-13 19:27:03 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1000.000000
05-13 19:27:03 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 1332.000000
05-13 19:27:03 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 76.000000
05-13 19:27:03 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:27:03 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
05-13 19:27:03 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:27:03 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
05-13 19:27:03 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 168.000000
05-13 19:27:03 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 55.000000
05-13 19:27:03 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 11.000000
05-13 19:27:03 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 167.000000
05-13 19:27:03 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 298.000000
05-13 19:27:03 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 536.000000
05-13 19:27:03 D/ProtoMeasurementBase: searchbar_state_loading: size = 1, sum: 2.000000
05-13 19:27:03 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 167.000000
05-13 19:27:03 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 6.000000
05-13 19:27:03 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 160.000000
05-13 19:27:03 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 55.000000
05-13 19:27:03 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 26.000000
05-13 19:27:03 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 433.000000
05-13 19:27:03 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1004.000000
05-13 19:27:03 D/ProtoMeasurementBase: searchbar_state_listening: size = 3, sum: 167.000000
05-13 19:27:03 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 328.000000
05-13 19:27:03 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 167.000000
05-13 19:27:03 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 5.000000
05-13 19:27:03 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1000.000000
05-13 19:27:03 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 1332.000000
05-13 19:27:03 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 76.000000
05-13 19:27:03 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:27:03 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
05-13 19:27:03 I/MeasurementPrinter:            76.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
05-13 19:27:03 E/TvtsBaseAssistantTest: Run 4/20 encountered exception. See logs for details
05-13 19:27:03 E/TvtsBaseAssistantTest: HiTest failed: 
com.google.android.assistant.tvts.HiTest:
Error in testHiResponse(com.google.android.assistant.tvts.HiTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HiTest.testHiResponse(HiTest.java:33)


Time: 64.698
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HiTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HiTest.testHiResponse(HiTest.java:33)

FAILURES!!!
Tests run: 1,  Failures: 1



05-13 19:27:03 D/RunUtil: Running command null without timeout.
05-13 19:27:03 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:27:04 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:27:04 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:27:04 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:27:04 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:27:04 D/RunUtil: Running command null without timeout.
05-13 19:27:04 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:27:04 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:27:04 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:27:04 D/RunUtil: Running command null without timeout.
05-13 19:27:04 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:27:05 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:27:05 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:27:05 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:27:05 I/DeviceStateMonitor: Waiting 359964 ms for device SKBFXYZO0C1V package manager
05-13 19:27:05 I/NativeDeviceStateMonitor: Waiting 359902 ms for device SKBFXYZO0C1V external store
05-13 19:27:06 D/RunUtil: Running command null without timeout.
05-13 19:27:07 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:27:07 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:27:07 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:27:07 D/RunUtil: Running command null without timeout.
05-13 19:27:07 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:27:07 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:27:07 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:27:07 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:27:07 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
05-13 19:27:07 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:27:08 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/2208ded8-50a5-4e77-9eb8-bbae18935fbe/tmp/katniss-primes-2024-05-13T03_21_26.606_16949973272396416300.txt] without timeout.
05-13 19:27:08 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
05-13 19:27:08 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
05-13 19:27:08 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
05-13 19:27:08 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HiTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
05-13 19:28:15 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:28:15 D/ProtoMeasurementBase: Begin Parse: search-to-query
05-13 19:28:15 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 208.000000
05-13 19:28:15 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 54.000000
05-13 19:28:15 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 5.000000
05-13 19:28:15 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 207.000000
05-13 19:28:15 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 389.000000
05-13 19:28:15 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 496.000000
05-13 19:28:15 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1397.000000
05-13 19:28:15 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 208.000000
05-13 19:28:15 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 9.000000
05-13 19:28:15 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 197.000000
05-13 19:28:15 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 55.000000
05-13 19:28:15 D/ProtoMeasurementBase: searchbar_state_transcribing: size = 1, sum: 354.000000
05-13 19:28:15 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 390.000000
05-13 19:28:15 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1396.000000
05-13 19:28:15 D/ProtoMeasurementBase: searchbar_state_listening: size = 3, sum: 251.000000
05-13 19:28:15 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 410.000000
05-13 19:28:15 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 207.000000
05-13 19:28:15 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 17.000000
05-13 19:28:15 D/ProtoMeasurementBase: query_duration: size = 1, sum: 918.000000
05-13 19:28:15 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 1806.000000
05-13 19:28:15 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 128.000000
05-13 19:28:15 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
05-13 19:28:15 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:28:15 D/ProtoMeasurementBase: Begin Parse: query-to-result
05-13 19:28:15 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 208.000000
05-13 19:28:15 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 54.000000
05-13 19:28:15 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 5.000000
05-13 19:28:15 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 207.000000
05-13 19:28:15 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 389.000000
05-13 19:28:15 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 496.000000
05-13 19:28:15 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1397.000000
05-13 19:28:15 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 208.000000
05-13 19:28:15 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 9.000000
05-13 19:28:15 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 197.000000
05-13 19:28:15 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 55.000000
05-13 19:28:15 D/ProtoMeasurementBase: searchbar_state_transcribing: size = 1, sum: 354.000000
05-13 19:28:15 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 390.000000
05-13 19:28:15 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1396.000000
05-13 19:28:15 D/ProtoMeasurementBase: Adding required latency: query_recognized_to_result
05-13 19:28:15 D/ProtoMeasurementBase: searchbar_state_listening: size = 3, sum: 251.000000
05-13 19:28:15 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 410.000000
05-13 19:28:15 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 207.000000
05-13 19:28:15 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 17.000000
05-13 19:28:15 D/ProtoMeasurementBase: query_duration: size = 1, sum: 918.000000
05-13 19:28:15 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 1806.000000
05-13 19:28:15 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 128.000000
05-13 19:28:15 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:28:15 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
05-13 19:28:15 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:28:16 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
05-13 19:28:16 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 208.000000
05-13 19:28:16 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 54.000000
05-13 19:28:16 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 5.000000
05-13 19:28:16 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 207.000000
05-13 19:28:16 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 389.000000
05-13 19:28:16 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 496.000000
05-13 19:28:16 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1397.000000
05-13 19:28:16 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 208.000000
05-13 19:28:16 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 9.000000
05-13 19:28:16 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 197.000000
05-13 19:28:16 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 55.000000
05-13 19:28:16 D/ProtoMeasurementBase: searchbar_state_transcribing: size = 1, sum: 354.000000
05-13 19:28:16 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 390.000000
05-13 19:28:16 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1396.000000
05-13 19:28:16 D/ProtoMeasurementBase: searchbar_state_listening: size = 3, sum: 251.000000
05-13 19:28:16 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 410.000000
05-13 19:28:16 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 207.000000
05-13 19:28:16 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 17.000000
05-13 19:28:16 D/ProtoMeasurementBase: query_duration: size = 1, sum: 918.000000
05-13 19:28:16 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 1806.000000
05-13 19:28:16 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 128.000000
05-13 19:28:16 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:28:16 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
05-13 19:28:16 I/MeasurementPrinter:           128.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
05-13 19:28:16 E/TvtsBaseAssistantTest: Run 5/20 encountered exception. See logs for details
05-13 19:28:16 E/TvtsBaseAssistantTest: HiTest failed: 
com.google.android.assistant.tvts.HiTest:
Error in testHiResponse(com.google.android.assistant.tvts.HiTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HiTest.testHiResponse(HiTest.java:33)


Time: 64.958
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HiTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HiTest.testHiResponse(HiTest.java:33)

FAILURES!!!
Tests run: 1,  Failures: 1



05-13 19:28:16 D/RunUtil: Running command null without timeout.
05-13 19:28:16 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:28:16 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:28:16 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:28:16 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:28:17 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:28:17 D/RunUtil: Running command null without timeout.
05-13 19:28:17 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:28:17 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:28:17 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:28:17 D/RunUtil: Running command null without timeout.
05-13 19:28:17 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:28:17 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:28:17 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:28:17 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:28:17 I/DeviceStateMonitor: Waiting 359964 ms for device SKBFXYZO0C1V package manager
05-13 19:28:17 I/NativeDeviceStateMonitor: Waiting 359902 ms for device SKBFXYZO0C1V external store
05-13 19:28:19 D/RunUtil: Running command null without timeout.
05-13 19:28:19 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:28:19 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:28:19 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:28:19 D/RunUtil: Running command null without timeout.
05-13 19:28:19 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:28:19 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:28:20 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:28:20 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:28:20 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
05-13 19:28:20 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:28:20 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/2208ded8-50a5-4e77-9eb8-bbae18935fbe/tmp/katniss-primes-2024-05-13T03_21_26.606_14945710110203819643.txt] without timeout.
05-13 19:28:21 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
05-13 19:28:21 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
05-13 19:28:21 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
05-13 19:28:21 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HiTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
05-13 19:29:28 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:29:28 D/ProtoMeasurementBase: Begin Parse: search-to-query
05-13 19:29:28 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 161.000000
05-13 19:29:28 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 39.000000
05-13 19:29:28 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 7.000000
05-13 19:29:28 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 155.000000
05-13 19:29:28 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 342.000000
05-13 19:29:28 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 464.000000
05-13 19:29:28 D/ProtoMeasurementBase: searchbar_state_loading: size = 1, sum: 2.000000
05-13 19:29:28 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 160.000000
05-13 19:29:28 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 24.000000
05-13 19:29:28 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 186.000000
05-13 19:29:28 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 39.000000
05-13 19:29:28 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 34.000000
05-13 19:29:28 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 357.000000
05-13 19:29:28 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1403.000000
05-13 19:29:28 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 35.000000
05-13 19:29:28 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 341.000000
05-13 19:29:28 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 155.000000
05-13 19:29:28 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 8.000000
05-13 19:29:28 D/ProtoMeasurementBase: query_duration: size = 1, sum: 982.000000
05-13 19:29:28 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 1742.000000
05-13 19:29:28 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 98.000000
05-13 19:29:28 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
05-13 19:29:28 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:29:28 D/ProtoMeasurementBase: Begin Parse: query-to-result
05-13 19:29:28 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 161.000000
05-13 19:29:28 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 39.000000
05-13 19:29:28 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 7.000000
05-13 19:29:28 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 155.000000
05-13 19:29:28 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 342.000000
05-13 19:29:28 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 464.000000
05-13 19:29:28 D/ProtoMeasurementBase: searchbar_state_loading: size = 1, sum: 2.000000
05-13 19:29:28 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 160.000000
05-13 19:29:28 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 24.000000
05-13 19:29:28 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 186.000000
05-13 19:29:28 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 39.000000
05-13 19:29:28 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 34.000000
05-13 19:29:28 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 357.000000
05-13 19:29:28 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1403.000000
05-13 19:29:28 D/ProtoMeasurementBase: Adding required latency: query_recognized_to_result
05-13 19:29:28 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 35.000000
05-13 19:29:28 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 341.000000
05-13 19:29:28 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 155.000000
05-13 19:29:28 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 8.000000
05-13 19:29:28 D/ProtoMeasurementBase: query_duration: size = 1, sum: 982.000000
05-13 19:29:28 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 1742.000000
05-13 19:29:28 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 98.000000
05-13 19:29:28 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:29:28 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
05-13 19:29:28 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:29:28 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
05-13 19:29:28 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 161.000000
05-13 19:29:28 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 39.000000
05-13 19:29:28 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 7.000000
05-13 19:29:28 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 155.000000
05-13 19:29:28 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 342.000000
05-13 19:29:28 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 464.000000
05-13 19:29:28 D/ProtoMeasurementBase: searchbar_state_loading: size = 1, sum: 2.000000
05-13 19:29:28 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 160.000000
05-13 19:29:28 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 24.000000
05-13 19:29:28 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 186.000000
05-13 19:29:28 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 39.000000
05-13 19:29:28 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 34.000000
05-13 19:29:28 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 357.000000
05-13 19:29:28 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1403.000000
05-13 19:29:28 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 35.000000
05-13 19:29:28 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 341.000000
05-13 19:29:28 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 155.000000
05-13 19:29:28 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 8.000000
05-13 19:29:28 D/ProtoMeasurementBase: query_duration: size = 1, sum: 982.000000
05-13 19:29:28 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 1742.000000
05-13 19:29:28 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 98.000000
05-13 19:29:28 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:29:28 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
05-13 19:29:28 I/MeasurementPrinter:            98.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
05-13 19:29:28 E/TvtsBaseAssistantTest: Run 6/20 encountered exception. See logs for details
05-13 19:29:28 E/TvtsBaseAssistantTest: HiTest failed: 
com.google.android.assistant.tvts.HiTest:
Error in testHiResponse(com.google.android.assistant.tvts.HiTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HiTest.testHiResponse(HiTest.java:33)


Time: 64.972
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HiTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HiTest.testHiResponse(HiTest.java:33)

FAILURES!!!
Tests run: 1,  Failures: 1



05-13 19:29:28 D/RunUtil: Running command null without timeout.
05-13 19:29:28 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:29:29 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:29:29 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:29:29 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:29:30 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:29:30 D/RunUtil: Running command null without timeout.
05-13 19:29:30 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:29:30 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:29:30 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:29:30 D/RunUtil: Running command null without timeout.
05-13 19:29:30 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:29:30 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:29:30 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:29:30 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:29:30 I/DeviceStateMonitor: Waiting 359959 ms for device SKBFXYZO0C1V package manager
05-13 19:29:30 I/NativeDeviceStateMonitor: Waiting 359897 ms for device SKBFXYZO0C1V external store
05-13 19:29:32 D/RunUtil: Running command null without timeout.
05-13 19:29:32 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:29:32 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:29:32 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:29:32 D/RunUtil: Running command null without timeout.
05-13 19:29:32 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:29:32 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:29:32 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:29:33 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:29:33 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
05-13 19:29:33 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:29:33 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/2208ded8-50a5-4e77-9eb8-bbae18935fbe/tmp/katniss-primes-2024-05-13T03_21_26.606_14087903677033171795.txt] without timeout.
05-13 19:29:33 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
05-13 19:29:33 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
05-13 19:29:33 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
05-13 19:29:33 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HiTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
05-13 19:30:40 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:30:41 D/ProtoMeasurementBase: Begin Parse: search-to-query
05-13 19:30:41 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 158.000000
05-13 19:30:41 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 28.000000
05-13 19:30:41 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 6.000000
05-13 19:30:41 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 156.000000
05-13 19:30:41 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 399.000000
05-13 19:30:41 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 550.000000
05-13 19:30:41 D/ProtoMeasurementBase: searchbar_state_loading: size = 1, sum: 2.000000
05-13 19:30:41 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 158.000000
05-13 19:30:41 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 60.000000
05-13 19:30:41 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 164.000000
05-13 19:30:41 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 38.000000
05-13 19:30:41 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 23.000000
05-13 19:30:41 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 444.000000
05-13 19:30:41 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1461.000000
05-13 19:30:41 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 149.000000
05-13 19:30:41 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 318.000000
05-13 19:30:41 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 156.000000
05-13 19:30:41 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 13.000000
05-13 19:30:41 D/ProtoMeasurementBase: query_duration: size = 1, sum: 997.000000
05-13 19:30:41 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 1780.000000
05-13 19:30:41 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 143.000000
05-13 19:30:41 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
05-13 19:30:41 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:30:41 D/ProtoMeasurementBase: Begin Parse: query-to-result
05-13 19:30:41 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 158.000000
05-13 19:30:41 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 28.000000
05-13 19:30:41 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 6.000000
05-13 19:30:41 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 156.000000
05-13 19:30:41 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 399.000000
05-13 19:30:41 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 550.000000
05-13 19:30:41 D/ProtoMeasurementBase: searchbar_state_loading: size = 1, sum: 2.000000
05-13 19:30:41 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 158.000000
05-13 19:30:41 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 60.000000
05-13 19:30:41 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 164.000000
05-13 19:30:41 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 38.000000
05-13 19:30:41 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 23.000000
05-13 19:30:41 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 444.000000
05-13 19:30:41 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1461.000000
05-13 19:30:41 D/ProtoMeasurementBase: Adding required latency: query_recognized_to_result
05-13 19:30:41 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 149.000000
05-13 19:30:41 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 318.000000
05-13 19:30:41 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 156.000000
05-13 19:30:41 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 13.000000
05-13 19:30:41 D/ProtoMeasurementBase: query_duration: size = 1, sum: 997.000000
05-13 19:30:41 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 1780.000000
05-13 19:30:41 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 143.000000
05-13 19:30:41 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:30:41 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
05-13 19:30:41 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:30:41 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
05-13 19:30:41 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 158.000000
05-13 19:30:41 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 28.000000
05-13 19:30:41 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 6.000000
05-13 19:30:41 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 156.000000
05-13 19:30:41 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 399.000000
05-13 19:30:41 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 550.000000
05-13 19:30:41 D/ProtoMeasurementBase: searchbar_state_loading: size = 1, sum: 2.000000
05-13 19:30:41 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 158.000000
05-13 19:30:41 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 60.000000
05-13 19:30:41 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 164.000000
05-13 19:30:41 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 38.000000
05-13 19:30:41 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 23.000000
05-13 19:30:41 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 444.000000
05-13 19:30:41 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1461.000000
05-13 19:30:41 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 149.000000
05-13 19:30:41 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 318.000000
05-13 19:30:41 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 156.000000
05-13 19:30:41 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 13.000000
05-13 19:30:41 D/ProtoMeasurementBase: query_duration: size = 1, sum: 997.000000
05-13 19:30:41 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 1780.000000
05-13 19:30:41 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 143.000000
05-13 19:30:41 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:30:41 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
05-13 19:30:41 I/MeasurementPrinter:           143.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
05-13 19:30:41 E/TvtsBaseAssistantTest: Run 7/20 encountered exception. See logs for details
05-13 19:30:41 E/TvtsBaseAssistantTest: HiTest failed: 
com.google.android.assistant.tvts.HiTest:
Error in testHiResponse(com.google.android.assistant.tvts.HiTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HiTest.testHiResponse(HiTest.java:33)


Time: 64.878
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HiTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HiTest.testHiResponse(HiTest.java:33)

FAILURES!!!
Tests run: 1,  Failures: 1



05-13 19:30:41 D/RunUtil: Running command null without timeout.
05-13 19:30:41 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:30:42 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:30:42 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:30:42 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:30:42 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:30:42 D/RunUtil: Running command null without timeout.
05-13 19:30:42 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:30:42 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:30:42 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:30:42 D/RunUtil: Running command null without timeout.
05-13 19:30:42 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:30:42 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:30:42 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:30:42 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:30:43 I/DeviceStateMonitor: Waiting 359964 ms for device SKBFXYZO0C1V package manager
05-13 19:30:43 I/NativeDeviceStateMonitor: Waiting 359901 ms for device SKBFXYZO0C1V external store
05-13 19:30:44 D/RunUtil: Running command null without timeout.
05-13 19:30:44 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:30:45 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:30:45 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:30:45 D/RunUtil: Running command null without timeout.
05-13 19:30:45 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:30:45 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:30:45 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:30:45 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:30:45 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
05-13 19:30:45 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:30:45 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/2208ded8-50a5-4e77-9eb8-bbae18935fbe/tmp/katniss-primes-2024-05-13T03_21_26.606_9953263851905142223.txt] without timeout.
05-13 19:30:46 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
05-13 19:30:46 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
05-13 19:30:46 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
05-13 19:30:46 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HiTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
05-13 19:31:53 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:31:53 D/ProtoMeasurementBase: Begin Parse: search-to-query
05-13 19:31:53 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 188.000000
05-13 19:31:53 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 46.000000
05-13 19:31:53 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 6.000000
05-13 19:31:53 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 183.000000
05-13 19:31:53 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 309.000000
05-13 19:31:53 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 459.000000
05-13 19:31:53 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1296.000000
05-13 19:31:53 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 188.000000
05-13 19:31:53 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 29.000000
05-13 19:31:53 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 193.000000
05-13 19:31:53 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 48.000000
05-13 19:31:53 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 30.000000
05-13 19:31:53 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 353.000000
05-13 19:31:53 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1288.000000
05-13 19:31:53 D/ProtoMeasurementBase: searchbar_state_listening: size = 3, sum: 95.000000
05-13 19:31:53 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 381.000000
05-13 19:31:53 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 183.000000
05-13 19:31:53 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 5.000000
05-13 19:31:53 D/ProtoMeasurementBase: query_duration: size = 1, sum: 937.000000
05-13 19:31:53 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 1668.000000
05-13 19:31:53 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 124.000000
05-13 19:31:53 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
05-13 19:31:53 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:31:53 D/ProtoMeasurementBase: Begin Parse: query-to-result
05-13 19:31:53 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 188.000000
05-13 19:31:53 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 46.000000
05-13 19:31:53 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 6.000000
05-13 19:31:53 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 183.000000
05-13 19:31:53 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 309.000000
05-13 19:31:53 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 459.000000
05-13 19:31:53 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1296.000000
05-13 19:31:53 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 188.000000
05-13 19:31:53 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 29.000000
05-13 19:31:53 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 193.000000
05-13 19:31:53 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 48.000000
05-13 19:31:53 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 30.000000
05-13 19:31:53 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 353.000000
05-13 19:31:53 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1288.000000
05-13 19:31:53 D/ProtoMeasurementBase: Adding required latency: query_recognized_to_result
05-13 19:31:53 D/ProtoMeasurementBase: searchbar_state_listening: size = 3, sum: 95.000000
05-13 19:31:53 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 381.000000
05-13 19:31:53 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 183.000000
05-13 19:31:53 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 5.000000
05-13 19:31:53 D/ProtoMeasurementBase: query_duration: size = 1, sum: 937.000000
05-13 19:31:53 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 1668.000000
05-13 19:31:53 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 124.000000
05-13 19:31:53 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:31:53 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
05-13 19:31:53 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:31:53 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
05-13 19:31:53 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 188.000000
05-13 19:31:53 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 46.000000
05-13 19:31:53 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 6.000000
05-13 19:31:53 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 183.000000
05-13 19:31:53 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 309.000000
05-13 19:31:53 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 459.000000
05-13 19:31:53 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1296.000000
05-13 19:31:53 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 188.000000
05-13 19:31:53 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 29.000000
05-13 19:31:53 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 193.000000
05-13 19:31:53 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 48.000000
05-13 19:31:53 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 30.000000
05-13 19:31:53 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 353.000000
05-13 19:31:53 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1288.000000
05-13 19:31:53 D/ProtoMeasurementBase: searchbar_state_listening: size = 3, sum: 95.000000
05-13 19:31:53 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 381.000000
05-13 19:31:53 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 183.000000
05-13 19:31:53 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 5.000000
05-13 19:31:53 D/ProtoMeasurementBase: query_duration: size = 1, sum: 937.000000
05-13 19:31:53 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 1668.000000
05-13 19:31:53 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 124.000000
05-13 19:31:53 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:31:53 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
05-13 19:31:53 I/MeasurementPrinter:           124.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
05-13 19:31:53 E/TvtsBaseAssistantTest: Run 8/20 encountered exception. See logs for details
05-13 19:31:53 E/TvtsBaseAssistantTest: HiTest failed: 
com.google.android.assistant.tvts.HiTest:
Error in testHiResponse(com.google.android.assistant.tvts.HiTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HiTest.testHiResponse(HiTest.java:33)


Time: 64.953
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HiTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HiTest.testHiResponse(HiTest.java:33)

FAILURES!!!
Tests run: 1,  Failures: 1



05-13 19:31:53 D/RunUtil: Running command null without timeout.
05-13 19:31:54 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:31:54 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:31:54 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:31:54 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:31:55 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:31:55 D/RunUtil: Running command null without timeout.
05-13 19:31:55 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:31:55 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:31:55 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:31:55 D/RunUtil: Running command null without timeout.
05-13 19:31:55 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:31:55 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:31:55 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:31:55 I/NativeDeviceStateMonitor: Waiting 359999 ms for device SKBFXYZO0C1V boot complete
05-13 19:31:55 I/DeviceStateMonitor: Waiting 359964 ms for device SKBFXYZO0C1V package manager
05-13 19:31:55 I/NativeDeviceStateMonitor: Waiting 359902 ms for device SKBFXYZO0C1V external store
05-13 19:31:57 D/RunUtil: Running command null without timeout.
05-13 19:31:57 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:31:57 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:31:57 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:31:57 D/RunUtil: Running command null without timeout.
05-13 19:31:57 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:31:57 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:31:57 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:31:58 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:31:58 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
05-13 19:31:58 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:31:58 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/2208ded8-50a5-4e77-9eb8-bbae18935fbe/tmp/katniss-primes-2024-05-13T03_21_26.606_1995051172355216100.txt] without timeout.
05-13 19:31:58 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
05-13 19:31:58 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
05-13 19:31:58 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
05-13 19:31:58 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HiTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
05-13 19:33:06 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:33:06 D/ProtoMeasurementBase: Begin Parse: search-to-query
05-13 19:33:06 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 179.000000
05-13 19:33:06 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 43.000000
05-13 19:33:06 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 10.000000
05-13 19:33:06 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 176.000000
05-13 19:33:06 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 360.000000
05-13 19:33:06 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 442.000000
05-13 19:33:06 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1256.000000
05-13 19:33:06 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 176.000000
05-13 19:33:06 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 27.000000
05-13 19:33:06 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 184.000000
05-13 19:33:06 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 44.000000
05-13 19:33:06 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 31.000000
05-13 19:33:06 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 328.000000
05-13 19:33:06 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1248.000000
05-13 19:33:06 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 63.000000
05-13 19:33:06 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 362.000000
05-13 19:33:06 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 176.000000
05-13 19:33:06 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 3.000000
05-13 19:33:06 D/ProtoMeasurementBase: query_duration: size = 1, sum: 943.000000
05-13 19:33:06 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 1610.000000
05-13 19:33:06 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 107.000000
05-13 19:33:06 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
05-13 19:33:06 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:33:06 D/ProtoMeasurementBase: Begin Parse: query-to-result
05-13 19:33:06 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 179.000000
05-13 19:33:06 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 43.000000
05-13 19:33:06 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 10.000000
05-13 19:33:06 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 176.000000
05-13 19:33:06 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 360.000000
05-13 19:33:06 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 442.000000
05-13 19:33:06 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1256.000000
05-13 19:33:06 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 176.000000
05-13 19:33:06 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 27.000000
05-13 19:33:06 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 184.000000
05-13 19:33:06 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 44.000000
05-13 19:33:06 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 31.000000
05-13 19:33:06 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 328.000000
05-13 19:33:06 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1248.000000
05-13 19:33:06 D/ProtoMeasurementBase: Adding required latency: query_recognized_to_result
05-13 19:33:06 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 63.000000
05-13 19:33:06 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 362.000000
05-13 19:33:06 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 176.000000
05-13 19:33:06 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 3.000000
05-13 19:33:06 D/ProtoMeasurementBase: query_duration: size = 1, sum: 943.000000
05-13 19:33:06 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 1610.000000
05-13 19:33:06 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 107.000000
05-13 19:33:06 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:33:06 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
05-13 19:33:06 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:33:06 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
05-13 19:33:06 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 179.000000
05-13 19:33:06 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 43.000000
05-13 19:33:06 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 10.000000
05-13 19:33:06 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 176.000000
05-13 19:33:06 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 360.000000
05-13 19:33:06 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 442.000000
05-13 19:33:06 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1256.000000
05-13 19:33:06 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 176.000000
05-13 19:33:06 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 27.000000
05-13 19:33:06 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 184.000000
05-13 19:33:06 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 44.000000
05-13 19:33:06 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 31.000000
05-13 19:33:06 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 328.000000
05-13 19:33:06 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1248.000000
05-13 19:33:06 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 63.000000
05-13 19:33:06 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 362.000000
05-13 19:33:06 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 176.000000
05-13 19:33:06 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 3.000000
05-13 19:33:06 D/ProtoMeasurementBase: query_duration: size = 1, sum: 943.000000
05-13 19:33:06 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 1610.000000
05-13 19:33:06 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 107.000000
05-13 19:33:06 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:33:06 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
05-13 19:33:06 I/MeasurementPrinter:           107.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
05-13 19:33:06 E/TvtsBaseAssistantTest: Run 9/20 encountered exception. See logs for details
05-13 19:33:06 E/TvtsBaseAssistantTest: HiTest failed: 
com.google.android.assistant.tvts.HiTest:
Error in testHiResponse(com.google.android.assistant.tvts.HiTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HiTest.testHiResponse(HiTest.java:33)


Time: 64.914
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HiTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HiTest.testHiResponse(HiTest.java:33)

FAILURES!!!
Tests run: 1,  Failures: 1



05-13 19:33:06 D/RunUtil: Running command null without timeout.
05-13 19:33:06 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:33:07 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:33:07 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:33:07 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:33:07 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:33:07 D/RunUtil: Running command null without timeout.
05-13 19:33:07 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:33:08 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:33:08 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:33:08 D/RunUtil: Running command null without timeout.
05-13 19:33:08 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:33:08 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:33:08 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:33:08 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:33:08 I/DeviceStateMonitor: Waiting 359964 ms for device SKBFXYZO0C1V package manager
05-13 19:33:08 I/NativeDeviceStateMonitor: Waiting 359903 ms for device SKBFXYZO0C1V external store
05-13 19:33:10 D/RunUtil: Running command null without timeout.
05-13 19:33:10 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:33:10 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:33:10 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:33:10 D/RunUtil: Running command null without timeout.
05-13 19:33:10 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:33:10 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:33:10 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:33:11 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:33:11 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
05-13 19:33:11 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:33:11 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/2208ded8-50a5-4e77-9eb8-bbae18935fbe/tmp/katniss-primes-2024-05-13T03_21_26.606_14954925760672487589.txt] without timeout.
05-13 19:33:11 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
05-13 19:33:11 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
05-13 19:33:11 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
05-13 19:33:11 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HiTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
05-13 19:34:18 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:34:18 D/ProtoMeasurementBase: Begin Parse: search-to-query
05-13 19:34:18 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 184.000000
05-13 19:34:18 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 59.000000
05-13 19:34:18 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 9.000000
05-13 19:34:18 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 179.000000
05-13 19:34:18 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 476.000000
05-13 19:34:18 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 500.000000
05-13 19:34:18 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1616.000000
05-13 19:34:18 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 183.000000
05-13 19:34:18 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 19.000000
05-13 19:34:18 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 199.000000
05-13 19:34:18 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 59.000000
05-13 19:34:18 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 30.000000
05-13 19:34:18 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 400.000000
05-13 19:34:18 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1615.000000
05-13 19:34:18 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 135.000000
05-13 19:34:18 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 378.000000
05-13 19:34:18 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 179.000000
05-13 19:34:18 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 13.000000
05-13 19:34:18 D/ProtoMeasurementBase: query_duration: size = 1, sum: 943.000000
05-13 19:34:18 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 1992.000000
05-13 19:34:18 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 112.000000
05-13 19:34:18 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
05-13 19:34:18 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:34:19 D/ProtoMeasurementBase: Begin Parse: query-to-result
05-13 19:34:19 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 184.000000
05-13 19:34:19 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 59.000000
05-13 19:34:19 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 9.000000
05-13 19:34:19 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 179.000000
05-13 19:34:19 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 476.000000
05-13 19:34:19 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 500.000000
05-13 19:34:19 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1616.000000
05-13 19:34:19 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 183.000000
05-13 19:34:19 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 19.000000
05-13 19:34:19 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 199.000000
05-13 19:34:19 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 59.000000
05-13 19:34:19 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 30.000000
05-13 19:34:19 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 400.000000
05-13 19:34:19 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1615.000000
05-13 19:34:19 D/ProtoMeasurementBase: Adding required latency: query_recognized_to_result
05-13 19:34:19 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 135.000000
05-13 19:34:19 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 378.000000
05-13 19:34:19 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 179.000000
05-13 19:34:19 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 13.000000
05-13 19:34:19 D/ProtoMeasurementBase: query_duration: size = 1, sum: 943.000000
05-13 19:34:19 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 1992.000000
05-13 19:34:19 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 112.000000
05-13 19:34:19 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:34:19 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
05-13 19:34:19 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:34:19 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
05-13 19:34:19 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 184.000000
05-13 19:34:19 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 59.000000
05-13 19:34:19 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 9.000000
05-13 19:34:19 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 179.000000
05-13 19:34:19 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 476.000000
05-13 19:34:19 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 500.000000
05-13 19:34:19 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1616.000000
05-13 19:34:19 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 183.000000
05-13 19:34:19 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 19.000000
05-13 19:34:19 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 199.000000
05-13 19:34:19 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 59.000000
05-13 19:34:19 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 30.000000
05-13 19:34:19 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 400.000000
05-13 19:34:19 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1615.000000
05-13 19:34:19 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 135.000000
05-13 19:34:19 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 378.000000
05-13 19:34:19 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 179.000000
05-13 19:34:19 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 13.000000
05-13 19:34:19 D/ProtoMeasurementBase: query_duration: size = 1, sum: 943.000000
05-13 19:34:19 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 1992.000000
05-13 19:34:19 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 112.000000
05-13 19:34:19 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:34:19 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
05-13 19:34:19 I/MeasurementPrinter:           112.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
05-13 19:34:19 E/TvtsBaseAssistantTest: Run 10/20 encountered exception. See logs for details
05-13 19:34:19 E/TvtsBaseAssistantTest: HiTest failed: 
com.google.android.assistant.tvts.HiTest:
Error in testHiResponse(com.google.android.assistant.tvts.HiTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HiTest.testHiResponse(HiTest.java:33)


Time: 64.827
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HiTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HiTest.testHiResponse(HiTest.java:33)

FAILURES!!!
Tests run: 1,  Failures: 1



05-13 19:34:19 D/RunUtil: Running command null without timeout.
05-13 19:34:19 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:34:19 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:34:19 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:34:19 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:34:20 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:34:20 D/RunUtil: Running command null without timeout.
05-13 19:34:20 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:34:20 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:34:20 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:34:20 D/RunUtil: Running command null without timeout.
05-13 19:34:20 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:34:20 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:34:20 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:34:20 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:34:20 I/DeviceStateMonitor: Waiting 359964 ms for device SKBFXYZO0C1V package manager
05-13 19:34:20 I/NativeDeviceStateMonitor: Waiting 359902 ms for device SKBFXYZO0C1V external store
05-13 19:34:22 D/RunUtil: Running command null without timeout.
05-13 19:34:22 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:34:22 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:34:22 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:34:22 D/RunUtil: Running command null without timeout.
05-13 19:34:23 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:34:23 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:34:23 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:34:23 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:34:23 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
05-13 19:34:23 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:34:23 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/2208ded8-50a5-4e77-9eb8-bbae18935fbe/tmp/katniss-primes-2024-05-13T03_21_26.606_13036929875762722790.txt] without timeout.
05-13 19:34:24 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
05-13 19:34:24 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
05-13 19:34:24 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
05-13 19:34:24 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HiTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
05-13 19:35:31 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:35:31 D/ProtoMeasurementBase: Begin Parse: search-to-query
05-13 19:35:31 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 188.000000
05-13 19:35:31 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 66.000000
05-13 19:35:31 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 34.000000
05-13 19:35:31 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 186.000000
05-13 19:35:31 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 456.000000
05-13 19:35:31 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 525.000000
05-13 19:35:31 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 2621.000000
05-13 19:35:31 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 187.000000
05-13 19:35:31 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 25.000000
05-13 19:35:31 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 191.000000
05-13 19:35:31 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 69.000000
05-13 19:35:31 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 30.000000
05-13 19:35:31 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 419.000000
05-13 19:35:31 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 2615.000000
05-13 19:35:31 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 166.000000
05-13 19:35:31 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 377.000000
05-13 19:35:31 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 186.000000
05-13 19:35:31 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 7.000000
05-13 19:35:31 D/ProtoMeasurementBase: query_duration: size = 1, sum: 991.000000
05-13 19:35:31 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 2992.000000
05-13 19:35:31 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 107.000000
05-13 19:35:31 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
05-13 19:35:31 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:35:31 D/ProtoMeasurementBase: Begin Parse: query-to-result
05-13 19:35:31 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 188.000000
05-13 19:35:31 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 66.000000
05-13 19:35:31 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 34.000000
05-13 19:35:31 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 186.000000
05-13 19:35:31 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 456.000000
05-13 19:35:31 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 525.000000
05-13 19:35:31 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 2621.000000
05-13 19:35:31 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 187.000000
05-13 19:35:31 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 25.000000
05-13 19:35:31 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 191.000000
05-13 19:35:31 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 69.000000
05-13 19:35:31 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 30.000000
05-13 19:35:31 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 419.000000
05-13 19:35:31 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 2615.000000
05-13 19:35:31 D/ProtoMeasurementBase: Adding required latency: query_recognized_to_result
05-13 19:35:31 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 166.000000
05-13 19:35:31 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 377.000000
05-13 19:35:31 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 186.000000
05-13 19:35:31 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 7.000000
05-13 19:35:31 D/ProtoMeasurementBase: query_duration: size = 1, sum: 991.000000
05-13 19:35:31 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 2992.000000
05-13 19:35:31 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 107.000000
05-13 19:35:31 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:35:31 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
05-13 19:35:31 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:35:32 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
05-13 19:35:32 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 188.000000
05-13 19:35:32 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 66.000000
05-13 19:35:32 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 34.000000
05-13 19:35:32 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 186.000000
05-13 19:35:32 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 456.000000
05-13 19:35:32 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 525.000000
05-13 19:35:32 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 2621.000000
05-13 19:35:32 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 187.000000
05-13 19:35:32 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 25.000000
05-13 19:35:32 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 191.000000
05-13 19:35:32 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 69.000000
05-13 19:35:32 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 30.000000
05-13 19:35:32 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 419.000000
05-13 19:35:32 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 2615.000000
05-13 19:35:32 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 166.000000
05-13 19:35:32 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 377.000000
05-13 19:35:32 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 186.000000
05-13 19:35:32 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 7.000000
05-13 19:35:32 D/ProtoMeasurementBase: query_duration: size = 1, sum: 991.000000
05-13 19:35:32 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 2992.000000
05-13 19:35:32 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 107.000000
05-13 19:35:32 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:35:32 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
05-13 19:35:32 I/MeasurementPrinter:           107.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
05-13 19:35:32 E/TvtsBaseAssistantTest: Run 11/20 encountered exception. See logs for details
05-13 19:35:32 E/TvtsBaseAssistantTest: HiTest failed: 
com.google.android.assistant.tvts.HiTest:
Error in testHiResponse(com.google.android.assistant.tvts.HiTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HiTest.testHiResponse(HiTest.java:33)


Time: 64.895
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HiTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HiTest.testHiResponse(HiTest.java:33)

FAILURES!!!
Tests run: 1,  Failures: 1



05-13 19:35:32 D/RunUtil: Running command null without timeout.
05-13 19:35:32 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:35:32 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:35:32 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:35:32 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:35:33 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:35:33 D/RunUtil: Running command null without timeout.
05-13 19:35:33 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:35:33 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:35:33 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:35:33 D/RunUtil: Running command null without timeout.
05-13 19:35:33 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:35:33 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:35:33 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:35:33 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:35:33 I/DeviceStateMonitor: Waiting 359939 ms for device SKBFXYZO0C1V package manager
05-13 19:35:33 I/NativeDeviceStateMonitor: Waiting 359877 ms for device SKBFXYZO0C1V external store
05-13 19:35:35 D/RunUtil: Running command null without timeout.
05-13 19:35:35 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:35:35 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:35:35 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:35:35 D/RunUtil: Running command null without timeout.
05-13 19:35:35 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:35:35 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:35:36 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:35:36 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:35:36 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
05-13 19:35:36 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:35:36 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/2208ded8-50a5-4e77-9eb8-bbae18935fbe/tmp/katniss-primes-2024-05-13T03_21_26.606_753089097430195071.txt] without timeout.
05-13 19:35:37 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
05-13 19:35:37 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
05-13 19:35:37 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
05-13 19:35:37 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HiTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
05-13 19:36:44 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:36:44 D/ProtoMeasurementBase: Begin Parse: search-to-query
05-13 19:36:44 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 164.000000
05-13 19:36:44 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 62.000000
05-13 19:36:44 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 16.000000
05-13 19:36:44 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 163.000000
05-13 19:36:44 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 315.000000
05-13 19:36:44 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 558.000000
05-13 19:36:44 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1887.000000
05-13 19:36:44 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 164.000000
05-13 19:36:44 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 28.000000
05-13 19:36:44 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 140.000000
05-13 19:36:44 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 62.000000
05-13 19:36:44 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 27.000000
05-13 19:36:44 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 460.000000
05-13 19:36:44 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1882.000000
05-13 19:36:44 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 52.000000
05-13 19:36:44 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 305.000000
05-13 19:36:44 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 163.000000
05-13 19:36:44 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 10.000000
05-13 19:36:44 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1011.000000
05-13 19:36:44 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 2187.000000
05-13 19:36:44 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 77.000000
05-13 19:36:44 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
05-13 19:36:44 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:36:44 D/ProtoMeasurementBase: Begin Parse: query-to-result
05-13 19:36:44 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 164.000000
05-13 19:36:44 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 62.000000
05-13 19:36:44 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 16.000000
05-13 19:36:44 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 163.000000
05-13 19:36:44 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 315.000000
05-13 19:36:44 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 558.000000
05-13 19:36:44 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1887.000000
05-13 19:36:44 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 164.000000
05-13 19:36:44 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 28.000000
05-13 19:36:44 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 140.000000
05-13 19:36:44 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 62.000000
05-13 19:36:44 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 27.000000
05-13 19:36:44 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 460.000000
05-13 19:36:44 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1882.000000
05-13 19:36:44 D/ProtoMeasurementBase: Adding required latency: query_recognized_to_result
05-13 19:36:44 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 52.000000
05-13 19:36:44 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 305.000000
05-13 19:36:44 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 163.000000
05-13 19:36:44 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 10.000000
05-13 19:36:44 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1011.000000
05-13 19:36:44 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 2187.000000
05-13 19:36:44 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 77.000000
05-13 19:36:44 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:36:44 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
05-13 19:36:44 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:36:44 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
05-13 19:36:44 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 164.000000
05-13 19:36:44 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 62.000000
05-13 19:36:44 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 16.000000
05-13 19:36:44 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 163.000000
05-13 19:36:44 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 315.000000
05-13 19:36:44 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 558.000000
05-13 19:36:44 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1887.000000
05-13 19:36:44 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 164.000000
05-13 19:36:44 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 28.000000
05-13 19:36:44 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 140.000000
05-13 19:36:44 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 62.000000
05-13 19:36:44 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 27.000000
05-13 19:36:44 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 460.000000
05-13 19:36:44 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1882.000000
05-13 19:36:44 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 52.000000
05-13 19:36:44 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 305.000000
05-13 19:36:44 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 163.000000
05-13 19:36:44 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 10.000000
05-13 19:36:44 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1011.000000
05-13 19:36:44 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 2187.000000
05-13 19:36:44 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 77.000000
05-13 19:36:44 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:36:44 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
05-13 19:36:44 I/MeasurementPrinter:            77.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
05-13 19:36:44 E/TvtsBaseAssistantTest: Run 12/20 encountered exception. See logs for details
05-13 19:36:44 E/TvtsBaseAssistantTest: HiTest failed: 
com.google.android.assistant.tvts.HiTest:
Error in testHiResponse(com.google.android.assistant.tvts.HiTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HiTest.testHiResponse(HiTest.java:33)


Time: 64.914
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HiTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HiTest.testHiResponse(HiTest.java:33)

FAILURES!!!
Tests run: 1,  Failures: 1



05-13 19:36:44 D/RunUtil: Running command null without timeout.
05-13 19:36:44 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:36:45 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:36:45 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:36:45 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:36:46 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:36:46 D/RunUtil: Running command null without timeout.
05-13 19:36:46 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:36:46 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:36:46 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:36:46 D/RunUtil: Running command null without timeout.
05-13 19:36:46 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:36:46 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:36:46 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:36:46 I/NativeDeviceStateMonitor: Waiting 359999 ms for device SKBFXYZO0C1V boot complete
05-13 19:36:46 I/DeviceStateMonitor: Waiting 359938 ms for device SKBFXYZO0C1V package manager
05-13 19:36:46 I/NativeDeviceStateMonitor: Waiting 359877 ms for device SKBFXYZO0C1V external store
05-13 19:36:48 D/RunUtil: Running command null without timeout.
05-13 19:36:48 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:36:48 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:36:48 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:36:48 D/RunUtil: Running command null without timeout.
05-13 19:36:48 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:36:48 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:36:48 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:36:49 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:36:49 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
05-13 19:36:49 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:36:49 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/2208ded8-50a5-4e77-9eb8-bbae18935fbe/tmp/katniss-primes-2024-05-13T03_21_26.606_3545532966673539819.txt] without timeout.
05-13 19:36:49 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
05-13 19:36:49 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
05-13 19:36:49 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
05-13 19:36:49 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HiTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
05-13 19:37:56 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:37:57 D/ProtoMeasurementBase: Begin Parse: search-to-query
05-13 19:37:57 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 169.000000
05-13 19:37:57 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 37.000000
05-13 19:37:57 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 16.000000
05-13 19:37:57 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 167.000000
05-13 19:37:57 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 301.000000
05-13 19:37:57 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 480.000000
05-13 19:37:57 D/ProtoMeasurementBase: searchbar_state_loading: size = 1, sum: 1040.000000
05-13 19:37:57 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 168.000000
05-13 19:37:57 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 20.000000
05-13 19:37:57 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 158.000000
05-13 19:37:57 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 41.000000
05-13 19:37:57 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 26.000000
05-13 19:37:57 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 378.000000
05-13 19:37:57 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1040.000000
05-13 19:37:57 D/ProtoMeasurementBase: searchbar_state_listening: size = 3, sum: 207.000000
05-13 19:37:57 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 324.000000
05-13 19:37:57 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 167.000000
05-13 19:37:57 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 4.000000
05-13 19:37:57 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 1363.000000
05-13 19:37:57 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 85.000000
05-13 19:37:57 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
05-13 19:37:57 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:37:57 D/ProtoMeasurementBase: Begin Parse: query-to-result
05-13 19:37:57 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 169.000000
05-13 19:37:57 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 37.000000
05-13 19:37:57 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 16.000000
05-13 19:37:57 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 167.000000
05-13 19:37:57 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 301.000000
05-13 19:37:57 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 480.000000
05-13 19:37:57 D/ProtoMeasurementBase: searchbar_state_loading: size = 1, sum: 1040.000000
05-13 19:37:57 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 168.000000
05-13 19:37:57 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 20.000000
05-13 19:37:57 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 158.000000
05-13 19:37:57 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 41.000000
05-13 19:37:57 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 26.000000
05-13 19:37:57 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 378.000000
05-13 19:37:57 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1040.000000
05-13 19:37:57 D/ProtoMeasurementBase: Adding required latency: query_recognized_to_result
05-13 19:37:57 D/ProtoMeasurementBase: searchbar_state_listening: size = 3, sum: 207.000000
05-13 19:37:57 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 324.000000
05-13 19:37:57 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 167.000000
05-13 19:37:57 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 4.000000
05-13 19:37:57 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 1363.000000
05-13 19:37:57 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 85.000000
05-13 19:37:57 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:37:57 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
05-13 19:37:57 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:37:57 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
05-13 19:37:57 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 169.000000
05-13 19:37:57 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 37.000000
05-13 19:37:57 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 16.000000
05-13 19:37:57 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 167.000000
05-13 19:37:57 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 301.000000
05-13 19:37:57 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 480.000000
05-13 19:37:57 D/ProtoMeasurementBase: searchbar_state_loading: size = 1, sum: 1040.000000
05-13 19:37:57 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 168.000000
05-13 19:37:57 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 20.000000
05-13 19:37:57 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 158.000000
05-13 19:37:57 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 41.000000
05-13 19:37:57 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 26.000000
05-13 19:37:57 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 378.000000
05-13 19:37:57 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1040.000000
05-13 19:37:57 D/ProtoMeasurementBase: searchbar_state_listening: size = 3, sum: 207.000000
05-13 19:37:57 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 324.000000
05-13 19:37:57 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 167.000000
05-13 19:37:57 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 4.000000
05-13 19:37:57 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 1363.000000
05-13 19:37:57 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 85.000000
05-13 19:37:57 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:37:57 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
05-13 19:37:57 I/MeasurementPrinter:            85.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
05-13 19:37:57 E/TvtsBaseAssistantTest: Run 13/20 encountered exception. See logs for details
05-13 19:37:57 E/TvtsBaseAssistantTest: HiTest failed: 
com.google.android.assistant.tvts.HiTest:
Error in testHiResponse(com.google.android.assistant.tvts.HiTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HiTest.testHiResponse(HiTest.java:33)


Time: 64.926
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HiTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HiTest.testHiResponse(HiTest.java:33)

FAILURES!!!
Tests run: 1,  Failures: 1



05-13 19:37:57 D/RunUtil: Running command null without timeout.
05-13 19:37:57 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:37:58 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:37:58 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:37:58 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:37:58 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:37:58 D/RunUtil: Running command null without timeout.
05-13 19:37:58 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:37:58 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:37:58 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:37:58 D/RunUtil: Running command null without timeout.
05-13 19:37:58 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:37:59 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:37:59 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:37:59 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:37:59 I/DeviceStateMonitor: Waiting 359964 ms for device SKBFXYZO0C1V package manager
05-13 19:37:59 I/NativeDeviceStateMonitor: Waiting 359902 ms for device SKBFXYZO0C1V external store
05-13 19:38:01 D/RunUtil: Running command null without timeout.
05-13 19:38:01 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:38:01 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:38:01 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:38:01 D/RunUtil: Running command null without timeout.
05-13 19:38:01 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:38:01 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:38:01 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:38:01 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:38:01 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
05-13 19:38:02 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:38:02 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/2208ded8-50a5-4e77-9eb8-bbae18935fbe/tmp/katniss-primes-2024-05-13T03_21_26.606_837511303758732197.txt] without timeout.
05-13 19:38:02 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
05-13 19:38:02 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
05-13 19:38:02 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
05-13 19:38:02 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HiTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
05-13 19:39:09 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:39:09 D/ProtoMeasurementBase: Begin Parse: search-to-query
05-13 19:39:09 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 178.000000
05-13 19:39:09 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 77.000000
05-13 19:39:09 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 8.000000
05-13 19:39:09 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 173.000000
05-13 19:39:09 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 436.000000
05-13 19:39:09 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 381.000000
05-13 19:39:09 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1745.000000
05-13 19:39:09 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 177.000000
05-13 19:39:09 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 28.000000
05-13 19:39:09 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 237.000000
05-13 19:39:09 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 76.000000
05-13 19:39:09 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 25.000000
05-13 19:39:09 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 273.000000
05-13 19:39:09 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1743.000000
05-13 19:39:09 D/ProtoMeasurementBase: searchbar_state_listening: size = 3, sum: 250.000000
05-13 19:39:09 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 415.000000
05-13 19:39:09 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 173.000000
05-13 19:39:09 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 3.000000
05-13 19:39:09 D/ProtoMeasurementBase: query_duration: size = 1, sum: 810.000000
05-13 19:39:09 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 2159.000000
05-13 19:39:09 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 105.000000
05-13 19:39:09 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
05-13 19:39:09 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:39:10 D/ProtoMeasurementBase: Begin Parse: query-to-result
05-13 19:39:10 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 178.000000
05-13 19:39:10 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 77.000000
05-13 19:39:10 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 8.000000
05-13 19:39:10 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 173.000000
05-13 19:39:10 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 436.000000
05-13 19:39:10 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 381.000000
05-13 19:39:10 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1745.000000
05-13 19:39:10 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 177.000000
05-13 19:39:10 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 28.000000
05-13 19:39:10 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 237.000000
05-13 19:39:10 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 76.000000
05-13 19:39:10 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 25.000000
05-13 19:39:10 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 273.000000
05-13 19:39:10 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1743.000000
05-13 19:39:10 D/ProtoMeasurementBase: Adding required latency: query_recognized_to_result
05-13 19:39:10 D/ProtoMeasurementBase: searchbar_state_listening: size = 3, sum: 250.000000
05-13 19:39:10 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 415.000000
05-13 19:39:10 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 173.000000
05-13 19:39:10 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 3.000000
05-13 19:39:10 D/ProtoMeasurementBase: query_duration: size = 1, sum: 810.000000
05-13 19:39:10 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 2159.000000
05-13 19:39:10 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 105.000000
05-13 19:39:10 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:39:10 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
05-13 19:39:10 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:39:10 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
05-13 19:39:10 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 178.000000
05-13 19:39:10 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 77.000000
05-13 19:39:10 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 8.000000
05-13 19:39:10 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 173.000000
05-13 19:39:10 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 436.000000
05-13 19:39:10 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 381.000000
05-13 19:39:10 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1745.000000
05-13 19:39:10 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 177.000000
05-13 19:39:10 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 28.000000
05-13 19:39:10 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 237.000000
05-13 19:39:10 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 76.000000
05-13 19:39:10 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 25.000000
05-13 19:39:10 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 273.000000
05-13 19:39:10 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1743.000000
05-13 19:39:10 D/ProtoMeasurementBase: searchbar_state_listening: size = 3, sum: 250.000000
05-13 19:39:10 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 415.000000
05-13 19:39:10 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 173.000000
05-13 19:39:10 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 3.000000
05-13 19:39:10 D/ProtoMeasurementBase: query_duration: size = 1, sum: 810.000000
05-13 19:39:10 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 2159.000000
05-13 19:39:10 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 105.000000
05-13 19:39:10 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:39:10 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
05-13 19:39:10 I/MeasurementPrinter:           105.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
05-13 19:39:10 E/TvtsBaseAssistantTest: Run 14/20 encountered exception. See logs for details
05-13 19:39:10 E/TvtsBaseAssistantTest: HiTest failed: 
com.google.android.assistant.tvts.HiTest:
Error in testHiResponse(com.google.android.assistant.tvts.HiTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HiTest.testHiResponse(HiTest.java:33)


Time: 64.928
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HiTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HiTest.testHiResponse(HiTest.java:33)

FAILURES!!!
Tests run: 1,  Failures: 1



05-13 19:39:10 D/RunUtil: Running command null without timeout.
05-13 19:39:10 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:39:10 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:39:10 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:39:10 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:39:11 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:39:11 D/RunUtil: Running command null without timeout.
05-13 19:39:11 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:39:11 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:39:11 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:39:11 D/RunUtil: Running command null without timeout.
05-13 19:39:11 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:39:11 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:39:11 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:39:11 I/NativeDeviceStateMonitor: Waiting 359999 ms for device SKBFXYZO0C1V boot complete
05-13 19:39:11 I/DeviceStateMonitor: Waiting 359963 ms for device SKBFXYZO0C1V package manager
05-13 19:39:11 I/NativeDeviceStateMonitor: Waiting 359897 ms for device SKBFXYZO0C1V external store
05-13 19:39:13 D/RunUtil: Running command null without timeout.
05-13 19:39:13 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:39:14 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:39:14 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:39:14 D/RunUtil: Running command null without timeout.
05-13 19:39:14 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:39:14 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:39:14 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:39:14 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:39:14 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
05-13 19:39:14 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:39:14 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/2208ded8-50a5-4e77-9eb8-bbae18935fbe/tmp/katniss-primes-2024-05-13T03_21_26.606_13034878606339910871.txt] without timeout.
05-13 19:39:15 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
05-13 19:39:15 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
05-13 19:39:15 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
05-13 19:39:15 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HiTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
05-13 19:40:22 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:40:22 D/ProtoMeasurementBase: Begin Parse: search-to-query
05-13 19:40:22 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 168.000000
05-13 19:40:22 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 51.000000
05-13 19:40:22 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 4.000000
05-13 19:40:22 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 155.000000
05-13 19:40:22 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 376.000000
05-13 19:40:22 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 623.000000
05-13 19:40:22 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1064.000000
05-13 19:40:22 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 156.000000
05-13 19:40:22 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 32.000000
05-13 19:40:22 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 205.000000
05-13 19:40:22 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 51.000000
05-13 19:40:22 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 21.000000
05-13 19:40:22 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 519.000000
05-13 19:40:22 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1063.000000
05-13 19:40:22 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 66.000000
05-13 19:40:22 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 365.000000
05-13 19:40:22 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 155.000000
05-13 19:40:22 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 3.000000
05-13 19:40:22 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1218.000000
05-13 19:40:22 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 1428.000000
05-13 19:40:22 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 105.000000
05-13 19:40:22 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
05-13 19:40:22 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:40:22 D/ProtoMeasurementBase: Begin Parse: query-to-result
05-13 19:40:22 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 168.000000
05-13 19:40:22 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 51.000000
05-13 19:40:22 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 4.000000
05-13 19:40:22 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 155.000000
05-13 19:40:22 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 376.000000
05-13 19:40:22 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 623.000000
05-13 19:40:22 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1064.000000
05-13 19:40:22 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 156.000000
05-13 19:40:22 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 32.000000
05-13 19:40:22 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 205.000000
05-13 19:40:22 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 51.000000
05-13 19:40:22 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 21.000000
05-13 19:40:22 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 519.000000
05-13 19:40:22 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1063.000000
05-13 19:40:22 D/ProtoMeasurementBase: Adding required latency: query_recognized_to_result
05-13 19:40:22 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 66.000000
05-13 19:40:22 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 365.000000
05-13 19:40:22 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 155.000000
05-13 19:40:22 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 3.000000
05-13 19:40:22 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1218.000000
05-13 19:40:22 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 1428.000000
05-13 19:40:22 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 105.000000
05-13 19:40:22 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:40:22 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
05-13 19:40:22 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:40:22 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
05-13 19:40:22 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 168.000000
05-13 19:40:22 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 51.000000
05-13 19:40:22 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 4.000000
05-13 19:40:22 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 155.000000
05-13 19:40:22 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 376.000000
05-13 19:40:22 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 623.000000
05-13 19:40:22 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1064.000000
05-13 19:40:22 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 156.000000
05-13 19:40:22 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 32.000000
05-13 19:40:22 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 205.000000
05-13 19:40:22 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 51.000000
05-13 19:40:22 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 21.000000
05-13 19:40:22 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 519.000000
05-13 19:40:22 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1063.000000
05-13 19:40:22 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 66.000000
05-13 19:40:22 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 365.000000
05-13 19:40:22 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 155.000000
05-13 19:40:22 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 3.000000
05-13 19:40:22 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1218.000000
05-13 19:40:22 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 1428.000000
05-13 19:40:22 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 105.000000
05-13 19:40:22 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:40:22 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
05-13 19:40:22 I/MeasurementPrinter:           105.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
05-13 19:40:22 E/TvtsBaseAssistantTest: Run 15/20 encountered exception. See logs for details
05-13 19:40:22 E/TvtsBaseAssistantTest: HiTest failed: 
com.google.android.assistant.tvts.HiTest:
Error in testHiResponse(com.google.android.assistant.tvts.HiTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HiTest.testHiResponse(HiTest.java:33)


Time: 64.777
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HiTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HiTest.testHiResponse(HiTest.java:33)

FAILURES!!!
Tests run: 1,  Failures: 1



05-13 19:40:22 D/RunUtil: Running command null without timeout.
05-13 19:40:23 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:40:23 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:40:23 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:40:23 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:40:24 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:40:24 D/RunUtil: Running command null without timeout.
05-13 19:40:24 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:40:24 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:40:24 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:40:24 D/RunUtil: Running command null without timeout.
05-13 19:40:24 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:40:24 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:40:24 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:40:24 I/NativeDeviceStateMonitor: Waiting 359999 ms for device SKBFXYZO0C1V boot complete
05-13 19:40:24 I/DeviceStateMonitor: Waiting 359918 ms for device SKBFXYZO0C1V package manager
05-13 19:40:24 I/NativeDeviceStateMonitor: Waiting 359856 ms for device SKBFXYZO0C1V external store
05-13 19:40:26 D/RunUtil: Running command null without timeout.
05-13 19:40:26 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:40:26 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:40:26 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:40:26 D/RunUtil: Running command null without timeout.
05-13 19:40:26 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:40:26 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:40:26 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:40:27 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:40:27 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
05-13 19:40:27 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:40:27 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/2208ded8-50a5-4e77-9eb8-bbae18935fbe/tmp/katniss-primes-2024-05-13T03_21_26.606_13365188000587935273.txt] without timeout.
05-13 19:40:27 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
05-13 19:40:27 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
05-13 19:40:27 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
05-13 19:40:28 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HiTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
05-13 19:41:35 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:41:35 D/ProtoMeasurementBase: Begin Parse: search-to-query
05-13 19:41:35 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 143.000000
05-13 19:41:35 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 4.000000
05-13 19:41:35 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 139.000000
05-13 19:41:35 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 296.000000
05-13 19:41:35 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 452.000000
05-13 19:41:35 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 2.000000
05-13 19:41:35 D/ProtoMeasurementBase: searchbar_state_loading: size = 1, sum: 4.000000
05-13 19:41:35 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 27.000000
05-13 19:41:35 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 188.000000
05-13 19:41:35 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 11.000000
05-13 19:41:35 D/ProtoMeasurementBase: searchbar_state_listening: size = 3, sum: 264.000000
05-13 19:41:35 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 15.000000
05-13 19:41:35 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 111.000000
05-13 19:41:35 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
05-13 19:41:35 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 51.000000
05-13 19:41:35 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 2.000000
05-13 19:41:35 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 141.000000
05-13 19:41:35 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 86.000000
05-13 19:41:35 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 47.000000
05-13 19:41:35 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 357.000000
05-13 19:41:35 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 2035.000000
05-13 19:41:35 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 5.000000
05-13 19:41:35 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 23.000000
05-13 19:41:35 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 319.000000
05-13 19:41:35 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 139.000000
05-13 19:41:35 D/ProtoMeasurementBase: query_duration: size = 1, sum: 884.000000
05-13 19:41:35 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 2354.000000
05-13 19:41:35 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 54.000000
05-13 19:41:35 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:41:35 D/ProtoMeasurementBase: Begin Parse: query-to-result
05-13 19:41:35 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 143.000000
05-13 19:41:35 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 4.000000
05-13 19:41:35 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 139.000000
05-13 19:41:35 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 296.000000
05-13 19:41:35 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 452.000000
05-13 19:41:35 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 2.000000
05-13 19:41:35 D/ProtoMeasurementBase: searchbar_state_loading: size = 1, sum: 4.000000
05-13 19:41:35 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 27.000000
05-13 19:41:35 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 188.000000
05-13 19:41:35 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 11.000000
05-13 19:41:35 D/ProtoMeasurementBase: searchbar_state_listening: size = 3, sum: 264.000000
05-13 19:41:35 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 15.000000
05-13 19:41:35 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 111.000000
05-13 19:41:35 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 51.000000
05-13 19:41:35 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 2.000000
05-13 19:41:35 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 141.000000
05-13 19:41:35 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 86.000000
05-13 19:41:35 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 47.000000
05-13 19:41:35 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 357.000000
05-13 19:41:35 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 2035.000000
05-13 19:41:35 D/ProtoMeasurementBase: Adding required latency: query_recognized_to_result
05-13 19:41:35 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 5.000000
05-13 19:41:35 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 23.000000
05-13 19:41:35 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 319.000000
05-13 19:41:35 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 139.000000
05-13 19:41:35 D/ProtoMeasurementBase: query_duration: size = 1, sum: 884.000000
05-13 19:41:35 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 2354.000000
05-13 19:41:35 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 54.000000
05-13 19:41:35 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:41:35 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
05-13 19:41:35 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:41:35 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
05-13 19:41:35 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 143.000000
05-13 19:41:35 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 4.000000
05-13 19:41:35 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 139.000000
05-13 19:41:35 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 296.000000
05-13 19:41:35 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 452.000000
05-13 19:41:35 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 2.000000
05-13 19:41:35 D/ProtoMeasurementBase: searchbar_state_loading: size = 1, sum: 4.000000
05-13 19:41:35 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 27.000000
05-13 19:41:35 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 188.000000
05-13 19:41:35 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 11.000000
05-13 19:41:35 D/ProtoMeasurementBase: searchbar_state_listening: size = 3, sum: 264.000000
05-13 19:41:35 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 15.000000
05-13 19:41:35 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 111.000000
05-13 19:41:35 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 51.000000
05-13 19:41:35 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 2.000000
05-13 19:41:35 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 141.000000
05-13 19:41:35 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 86.000000
05-13 19:41:35 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 47.000000
05-13 19:41:35 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 357.000000
05-13 19:41:35 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 2035.000000
05-13 19:41:35 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 5.000000
05-13 19:41:35 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 23.000000
05-13 19:41:35 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 319.000000
05-13 19:41:35 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 139.000000
05-13 19:41:35 D/ProtoMeasurementBase: query_duration: size = 1, sum: 884.000000
05-13 19:41:35 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 2354.000000
05-13 19:41:35 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 54.000000
05-13 19:41:35 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:41:35 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
05-13 19:41:35 I/MeasurementPrinter:           111.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
05-13 19:41:35 E/TvtsBaseAssistantTest: Run 16/20 encountered exception. See logs for details
05-13 19:41:35 E/TvtsBaseAssistantTest: HiTest failed: 
com.google.android.assistant.tvts.HiTest:
Error in testHiResponse(com.google.android.assistant.tvts.HiTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HiTest.testHiResponse(HiTest.java:33)


Time: 64.982
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HiTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HiTest.testHiResponse(HiTest.java:33)

FAILURES!!!
Tests run: 1,  Failures: 1



05-13 19:41:35 D/RunUtil: Running command null without timeout.
05-13 19:41:35 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:41:36 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:41:36 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:41:36 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:41:37 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:41:37 D/RunUtil: Running command null without timeout.
05-13 19:41:37 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:41:37 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:41:37 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:41:37 D/RunUtil: Running command null without timeout.
05-13 19:41:37 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:41:37 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:41:37 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:41:37 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:41:37 I/DeviceStateMonitor: Waiting 359964 ms for device SKBFXYZO0C1V package manager
05-13 19:41:37 I/NativeDeviceStateMonitor: Waiting 359902 ms for device SKBFXYZO0C1V external store
05-13 19:41:39 D/RunUtil: Running command null without timeout.
05-13 19:41:39 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:41:39 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:41:39 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:41:39 D/RunUtil: Running command null without timeout.
05-13 19:41:39 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:41:39 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:41:39 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:41:40 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:41:40 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
05-13 19:41:40 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:41:40 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/2208ded8-50a5-4e77-9eb8-bbae18935fbe/tmp/katniss-primes-2024-05-13T03_21_26.606_10568501672302017171.txt] without timeout.
05-13 19:41:40 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
05-13 19:41:40 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
05-13 19:41:40 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
05-13 19:41:40 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HiTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
05-13 19:42:48 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:42:48 D/ProtoMeasurementBase: Begin Parse: search-to-query
05-13 19:42:48 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 189.000000
05-13 19:42:48 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 55.000000
05-13 19:42:48 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 3.000000
05-13 19:42:48 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 180.000000
05-13 19:42:48 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 333.000000
05-13 19:42:48 D/ProtoMeasurementBase: searchbar_state_loading: size = 1, sum: 1751.000000
05-13 19:42:48 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 181.000000
05-13 19:42:48 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 37.000000
05-13 19:42:48 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 186.000000
05-13 19:42:48 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 55.000000
05-13 19:42:48 D/ProtoMeasurementBase: searchbar_state_transcribing: size = 1, sum: 284.000000
05-13 19:42:48 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 342.000000
05-13 19:42:48 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1749.000000
05-13 19:42:48 D/ProtoMeasurementBase: searchbar_state_listening: size = 3, sum: 266.000000
05-13 19:42:48 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 365.000000
05-13 19:42:48 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 180.000000
05-13 19:42:48 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 8.000000
05-13 19:42:48 D/ProtoMeasurementBase: query_duration: size = 1, sum: 833.000000
05-13 19:42:48 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 2113.000000
05-13 19:42:48 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 93.000000
05-13 19:42:48 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
05-13 19:42:48 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:42:48 D/ProtoMeasurementBase: Begin Parse: query-to-result
05-13 19:42:48 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 189.000000
05-13 19:42:48 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 55.000000
05-13 19:42:48 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 3.000000
05-13 19:42:48 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 180.000000
05-13 19:42:48 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 333.000000
05-13 19:42:48 D/ProtoMeasurementBase: searchbar_state_loading: size = 1, sum: 1751.000000
05-13 19:42:48 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 181.000000
05-13 19:42:48 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 37.000000
05-13 19:42:48 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 186.000000
05-13 19:42:48 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 55.000000
05-13 19:42:48 D/ProtoMeasurementBase: searchbar_state_transcribing: size = 1, sum: 284.000000
05-13 19:42:48 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 342.000000
05-13 19:42:48 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1749.000000
05-13 19:42:48 D/ProtoMeasurementBase: Adding required latency: query_recognized_to_result
05-13 19:42:48 D/ProtoMeasurementBase: searchbar_state_listening: size = 3, sum: 266.000000
05-13 19:42:48 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 365.000000
05-13 19:42:48 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 180.000000
05-13 19:42:48 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 8.000000
05-13 19:42:48 D/ProtoMeasurementBase: query_duration: size = 1, sum: 833.000000
05-13 19:42:48 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 2113.000000
05-13 19:42:48 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 93.000000
05-13 19:42:48 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:42:48 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
05-13 19:42:48 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:42:48 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
05-13 19:42:48 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 189.000000
05-13 19:42:48 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 55.000000
05-13 19:42:48 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 3.000000
05-13 19:42:48 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 180.000000
05-13 19:42:48 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 333.000000
05-13 19:42:48 D/ProtoMeasurementBase: searchbar_state_loading: size = 1, sum: 1751.000000
05-13 19:42:48 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 181.000000
05-13 19:42:48 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 37.000000
05-13 19:42:48 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 186.000000
05-13 19:42:48 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 55.000000
05-13 19:42:48 D/ProtoMeasurementBase: searchbar_state_transcribing: size = 1, sum: 284.000000
05-13 19:42:48 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 342.000000
05-13 19:42:48 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1749.000000
05-13 19:42:48 D/ProtoMeasurementBase: searchbar_state_listening: size = 3, sum: 266.000000
05-13 19:42:48 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 365.000000
05-13 19:42:48 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 180.000000
05-13 19:42:48 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 8.000000
05-13 19:42:48 D/ProtoMeasurementBase: query_duration: size = 1, sum: 833.000000
05-13 19:42:48 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 2113.000000
05-13 19:42:48 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 93.000000
05-13 19:42:48 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:42:48 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
05-13 19:42:48 I/MeasurementPrinter:            93.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
05-13 19:42:48 E/TvtsBaseAssistantTest: Run 17/20 encountered exception. See logs for details
05-13 19:42:48 E/TvtsBaseAssistantTest: HiTest failed: 
com.google.android.assistant.tvts.HiTest:
Error in testHiResponse(com.google.android.assistant.tvts.HiTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HiTest.testHiResponse(HiTest.java:33)


Time: 65.116
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HiTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HiTest.testHiResponse(HiTest.java:33)

FAILURES!!!
Tests run: 1,  Failures: 1



05-13 19:42:48 D/RunUtil: Running command null without timeout.
05-13 19:42:48 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:42:49 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:42:49 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:42:49 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:42:50 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:42:50 D/RunUtil: Running command null without timeout.
05-13 19:42:50 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:42:50 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:42:50 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:42:50 D/RunUtil: Running command null without timeout.
05-13 19:42:50 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:42:50 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:42:50 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:42:50 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:42:50 I/DeviceStateMonitor: Waiting 359933 ms for device SKBFXYZO0C1V package manager
05-13 19:42:50 I/NativeDeviceStateMonitor: Waiting 359841 ms for device SKBFXYZO0C1V external store
05-13 19:42:52 D/RunUtil: Running command null without timeout.
05-13 19:42:52 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:42:52 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:42:52 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:42:52 D/RunUtil: Running command null without timeout.
05-13 19:42:52 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:42:52 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:42:52 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:42:53 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:42:53 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
05-13 19:42:53 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:42:53 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/2208ded8-50a5-4e77-9eb8-bbae18935fbe/tmp/katniss-primes-2024-05-13T03_21_26.606_16856575067808732679.txt] without timeout.
05-13 19:42:53 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
05-13 19:42:53 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
05-13 19:42:53 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
05-13 19:42:53 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HiTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
05-13 19:44:01 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:44:01 D/ProtoMeasurementBase: Begin Parse: search-to-query
05-13 19:44:01 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 167.000000
05-13 19:44:01 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 5.000000
05-13 19:44:01 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 162.000000
05-13 19:44:01 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 353.000000
05-13 19:44:01 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 421.000000
05-13 19:44:01 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 3.000000
05-13 19:44:01 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1247.000000
05-13 19:44:01 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 44.000000
05-13 19:44:01 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 171.000000
05-13 19:44:01 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 25.000000
05-13 19:44:01 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 90.000000
05-13 19:44:01 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 2.000000
05-13 19:44:01 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 107.000000
05-13 19:44:01 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
05-13 19:44:01 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 25.000000
05-13 19:44:01 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
05-13 19:44:01 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 163.000000
05-13 19:44:01 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 88.000000
05-13 19:44:01 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 26.000000
05-13 19:44:01 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 307.000000
05-13 19:44:01 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1247.000000
05-13 19:44:01 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 7.000000
05-13 19:44:01 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 35.000000
05-13 19:44:01 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 336.000000
05-13 19:44:01 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 162.000000
05-13 19:44:01 D/ProtoMeasurementBase: query_duration: size = 1, sum: 838.000000
05-13 19:44:01 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 1582.000000
05-13 19:44:01 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 42.000000
05-13 19:44:01 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:44:01 D/ProtoMeasurementBase: Begin Parse: query-to-result
05-13 19:44:01 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 167.000000
05-13 19:44:01 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 5.000000
05-13 19:44:01 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 162.000000
05-13 19:44:01 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 353.000000
05-13 19:44:01 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 421.000000
05-13 19:44:01 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 3.000000
05-13 19:44:01 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1247.000000
05-13 19:44:01 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 44.000000
05-13 19:44:01 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 171.000000
05-13 19:44:01 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 25.000000
05-13 19:44:01 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 90.000000
05-13 19:44:01 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 2.000000
05-13 19:44:01 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 107.000000
05-13 19:44:01 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 25.000000
05-13 19:44:01 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
05-13 19:44:01 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 163.000000
05-13 19:44:01 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 88.000000
05-13 19:44:01 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 26.000000
05-13 19:44:01 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 307.000000
05-13 19:44:01 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1247.000000
05-13 19:44:01 D/ProtoMeasurementBase: Adding required latency: query_recognized_to_result
05-13 19:44:01 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 7.000000
05-13 19:44:01 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 35.000000
05-13 19:44:01 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 336.000000
05-13 19:44:01 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 162.000000
05-13 19:44:01 D/ProtoMeasurementBase: query_duration: size = 1, sum: 838.000000
05-13 19:44:01 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 1582.000000
05-13 19:44:01 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 42.000000
05-13 19:44:01 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:44:01 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
05-13 19:44:01 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:44:01 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
05-13 19:44:01 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 167.000000
05-13 19:44:01 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 5.000000
05-13 19:44:01 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 162.000000
05-13 19:44:01 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 353.000000
05-13 19:44:01 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 421.000000
05-13 19:44:01 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 3.000000
05-13 19:44:01 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1247.000000
05-13 19:44:01 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 44.000000
05-13 19:44:01 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 171.000000
05-13 19:44:01 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 25.000000
05-13 19:44:01 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 90.000000
05-13 19:44:01 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 2.000000
05-13 19:44:01 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 107.000000
05-13 19:44:01 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 25.000000
05-13 19:44:01 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
05-13 19:44:01 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 163.000000
05-13 19:44:01 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 88.000000
05-13 19:44:01 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 26.000000
05-13 19:44:01 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 307.000000
05-13 19:44:01 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1247.000000
05-13 19:44:01 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 7.000000
05-13 19:44:01 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 35.000000
05-13 19:44:01 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 336.000000
05-13 19:44:01 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 162.000000
05-13 19:44:01 D/ProtoMeasurementBase: query_duration: size = 1, sum: 838.000000
05-13 19:44:01 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 1582.000000
05-13 19:44:01 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 42.000000
05-13 19:44:01 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:44:01 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
05-13 19:44:01 I/MeasurementPrinter:           107.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
05-13 19:44:01 E/TvtsBaseAssistantTest: Run 18/20 encountered exception. See logs for details
05-13 19:44:01 E/TvtsBaseAssistantTest: HiTest failed: 
com.google.android.assistant.tvts.HiTest:
Error in testHiResponse(com.google.android.assistant.tvts.HiTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HiTest.testHiResponse(HiTest.java:33)


Time: 65.207
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HiTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HiTest.testHiResponse(HiTest.java:33)

FAILURES!!!
Tests run: 1,  Failures: 1



05-13 19:44:01 D/RunUtil: Running command null without timeout.
05-13 19:44:01 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:44:02 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:44:02 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:44:02 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:44:03 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:44:03 D/RunUtil: Running command null without timeout.
05-13 19:44:03 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:44:03 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:44:03 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:44:03 D/RunUtil: Running command null without timeout.
05-13 19:44:03 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:44:03 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:44:03 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:44:03 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:44:03 I/DeviceStateMonitor: Waiting 359964 ms for device SKBFXYZO0C1V package manager
05-13 19:44:03 I/NativeDeviceStateMonitor: Waiting 359903 ms for device SKBFXYZO0C1V external store
05-13 19:44:05 D/RunUtil: Running command null without timeout.
05-13 19:44:05 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:44:05 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:44:05 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:44:05 D/RunUtil: Running command null without timeout.
05-13 19:44:05 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:44:05 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:44:05 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:44:06 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:44:06 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
05-13 19:44:06 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:44:06 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/2208ded8-50a5-4e77-9eb8-bbae18935fbe/tmp/katniss-primes-2024-05-13T03_21_26.606_1145995611992731807.txt] without timeout.
05-13 19:44:06 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
05-13 19:44:06 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
05-13 19:44:06 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
05-13 19:44:06 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HiTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
05-13 19:45:14 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:45:14 D/ProtoMeasurementBase: Begin Parse: search-to-query
05-13 19:45:14 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 165.000000
05-13 19:45:14 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 59.000000
05-13 19:45:14 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 20.000000
05-13 19:45:14 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 164.000000
05-13 19:45:14 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 387.000000
05-13 19:45:14 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 489.000000
05-13 19:45:14 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1590.000000
05-13 19:45:14 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 165.000000
05-13 19:45:14 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 11.000000
05-13 19:45:14 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 189.000000
05-13 19:45:14 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 56.000000
05-13 19:45:14 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 28.000000
05-13 19:45:14 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 382.000000
05-13 19:45:14 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1582.000000
05-13 19:45:14 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 115.000000
05-13 19:45:14 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 353.000000
05-13 19:45:14 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 164.000000
05-13 19:45:14 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 11.000000
05-13 19:45:14 D/ProtoMeasurementBase: query_duration: size = 1, sum: 919.000000
05-13 19:45:14 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 1935.000000
05-13 19:45:14 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 98.000000
05-13 19:45:14 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
05-13 19:45:14 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:45:14 D/ProtoMeasurementBase: Begin Parse: query-to-result
05-13 19:45:14 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 165.000000
05-13 19:45:14 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 59.000000
05-13 19:45:14 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 20.000000
05-13 19:45:14 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 164.000000
05-13 19:45:14 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 387.000000
05-13 19:45:14 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 489.000000
05-13 19:45:14 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1590.000000
05-13 19:45:14 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 165.000000
05-13 19:45:14 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 11.000000
05-13 19:45:14 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 189.000000
05-13 19:45:14 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 56.000000
05-13 19:45:14 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 28.000000
05-13 19:45:14 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 382.000000
05-13 19:45:14 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1582.000000
05-13 19:45:14 D/ProtoMeasurementBase: Adding required latency: query_recognized_to_result
05-13 19:45:14 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 115.000000
05-13 19:45:14 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 353.000000
05-13 19:45:14 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 164.000000
05-13 19:45:14 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 11.000000
05-13 19:45:14 D/ProtoMeasurementBase: query_duration: size = 1, sum: 919.000000
05-13 19:45:14 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 1935.000000
05-13 19:45:14 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 98.000000
05-13 19:45:14 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:45:14 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
05-13 19:45:14 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:45:14 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
05-13 19:45:14 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 165.000000
05-13 19:45:14 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 59.000000
05-13 19:45:14 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 20.000000
05-13 19:45:14 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 164.000000
05-13 19:45:14 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 387.000000
05-13 19:45:14 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 489.000000
05-13 19:45:14 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1590.000000
05-13 19:45:14 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 165.000000
05-13 19:45:14 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 11.000000
05-13 19:45:14 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 189.000000
05-13 19:45:14 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 56.000000
05-13 19:45:14 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 28.000000
05-13 19:45:14 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 382.000000
05-13 19:45:14 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1582.000000
05-13 19:45:14 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 115.000000
05-13 19:45:14 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 353.000000
05-13 19:45:14 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 164.000000
05-13 19:45:14 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 11.000000
05-13 19:45:14 D/ProtoMeasurementBase: query_duration: size = 1, sum: 919.000000
05-13 19:45:14 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 1935.000000
05-13 19:45:14 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 98.000000
05-13 19:45:14 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:45:14 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
05-13 19:45:14 I/MeasurementPrinter:            98.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
05-13 19:45:14 E/TvtsBaseAssistantTest: Run 19/20 encountered exception. See logs for details
05-13 19:45:14 E/TvtsBaseAssistantTest: HiTest failed: 
com.google.android.assistant.tvts.HiTest:
Error in testHiResponse(com.google.android.assistant.tvts.HiTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HiTest.testHiResponse(HiTest.java:33)


Time: 64.871
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HiTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HiTest.testHiResponse(HiTest.java:33)

FAILURES!!!
Tests run: 1,  Failures: 1



05-13 19:45:14 D/RunUtil: Running command null without timeout.
05-13 19:45:14 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:45:15 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:45:15 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:45:15 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:45:15 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:45:15 D/RunUtil: Running command null without timeout.
05-13 19:45:16 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:45:16 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:45:16 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:45:16 D/RunUtil: Running command null without timeout.
05-13 19:45:16 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:45:16 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:45:16 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:45:16 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:45:16 I/DeviceStateMonitor: Waiting 359958 ms for device SKBFXYZO0C1V package manager
05-13 19:45:16 I/NativeDeviceStateMonitor: Waiting 359897 ms for device SKBFXYZO0C1V external store
05-13 19:45:18 D/RunUtil: Running command null without timeout.
05-13 19:45:18 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:45:18 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:45:18 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:45:18 D/RunUtil: Running command null without timeout.
05-13 19:45:18 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:45:18 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:45:18 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:45:19 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:45:19 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
05-13 19:45:19 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:45:19 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/2208ded8-50a5-4e77-9eb8-bbae18935fbe/tmp/katniss-primes-2024-05-13T03_21_26.606_18126499249219503496.txt] without timeout.
05-13 19:45:19 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
05-13 19:45:19 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
05-13 19:45:19 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
05-13 19:45:19 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HiTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
05-13 19:46:26 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:46:26 D/ProtoMeasurementBase: Begin Parse: search-to-query
05-13 19:46:26 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 170.000000
05-13 19:46:26 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 9.000000
05-13 19:46:26 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 169.000000
05-13 19:46:26 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 369.000000
05-13 19:46:26 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 524.000000
05-13 19:46:26 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
05-13 19:46:26 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1438.000000
05-13 19:46:26 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 68.000000
05-13 19:46:26 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 208.000000
05-13 19:46:26 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 30.000000
05-13 19:46:26 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 101.000000
05-13 19:46:26 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 10.000000
05-13 19:46:26 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 126.000000
05-13 19:46:26 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
05-13 19:46:26 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 52.000000
05-13 19:46:26 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 2.000000
05-13 19:46:26 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 170.000000
05-13 19:46:26 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 110.000000
05-13 19:46:26 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 52.000000
05-13 19:46:26 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 424.000000
05-13 19:46:26 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1433.000000
05-13 19:46:26 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 50.000000
05-13 19:46:26 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 18.000000
05-13 19:46:26 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 376.000000
05-13 19:46:26 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 169.000000
05-13 19:46:26 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1044.000000
05-13 19:46:26 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 1810.000000
05-13 19:46:26 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 39.000000
05-13 19:46:26 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:46:27 D/ProtoMeasurementBase: Begin Parse: query-to-result
05-13 19:46:27 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 170.000000
05-13 19:46:27 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 9.000000
05-13 19:46:27 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 169.000000
05-13 19:46:27 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 369.000000
05-13 19:46:27 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 524.000000
05-13 19:46:27 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
05-13 19:46:27 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1438.000000
05-13 19:46:27 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 68.000000
05-13 19:46:27 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 208.000000
05-13 19:46:27 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 30.000000
05-13 19:46:27 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 101.000000
05-13 19:46:27 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 10.000000
05-13 19:46:27 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 126.000000
05-13 19:46:27 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 52.000000
05-13 19:46:27 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 2.000000
05-13 19:46:27 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 170.000000
05-13 19:46:27 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 110.000000
05-13 19:46:27 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 52.000000
05-13 19:46:27 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 424.000000
05-13 19:46:27 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1433.000000
05-13 19:46:27 D/ProtoMeasurementBase: Adding required latency: query_recognized_to_result
05-13 19:46:27 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 50.000000
05-13 19:46:27 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 18.000000
05-13 19:46:27 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 376.000000
05-13 19:46:27 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 169.000000
05-13 19:46:27 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1044.000000
05-13 19:46:27 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 1810.000000
05-13 19:46:27 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 39.000000
05-13 19:46:27 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:46:27 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
05-13 19:46:27 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:46:27 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
05-13 19:46:27 D/ProtoMeasurementBase: result_displayed_spock_carousel: size = 1, sum: 170.000000
05-13 19:46:27 D/ProtoMeasurementBase: searchbar_state_idle: size = 1, sum: 9.000000
05-13 19:46:27 D/ProtoMeasurementBase: new_result_displayed_spock_warm: size = 1, sum: 169.000000
05-13 19:46:27 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 369.000000
05-13 19:46:27 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 524.000000
05-13 19:46:27 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
05-13 19:46:27 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1438.000000
05-13 19:46:27 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 68.000000
05-13 19:46:27 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 208.000000
05-13 19:46:27 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 30.000000
05-13 19:46:27 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 101.000000
05-13 19:46:27 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 10.000000
05-13 19:46:27 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 126.000000
05-13 19:46:27 D/ProtoMeasurementBase: view_add_spock_carousel: size = 1, sum: 52.000000
05-13 19:46:27 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 2.000000
05-13 19:46:27 D/ProtoMeasurementBase: result_displayed_spock: size = 1, sum: 170.000000
05-13 19:46:27 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 110.000000
05-13 19:46:27 D/ProtoMeasurementBase: view_add_spock: size = 1, sum: 52.000000
05-13 19:46:27 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 424.000000
05-13 19:46:27 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1433.000000
05-13 19:46:27 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 50.000000
05-13 19:46:27 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 18.000000
05-13 19:46:27 D/ProtoMeasurementBase: e2e_client_carousel_response: size = 1, sum: 376.000000
05-13 19:46:27 D/ProtoMeasurementBase: new_result_displayed_spock_carousel_warm: size = 1, sum: 169.000000
05-13 19:46:27 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1044.000000
05-13 19:46:27 D/ProtoMeasurementBase: e2e_carousel_response: size = 1, sum: 1810.000000
05-13 19:46:27 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 39.000000
05-13 19:46:27 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:46:27 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
05-13 19:46:27 I/MeasurementPrinter:           126.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
05-13 19:46:27 E/TvtsBaseAssistantTest: Run 20/20 encountered exception. See logs for details
05-13 19:46:27 E/TvtsBaseAssistantTest: HiTest failed: 
com.google.android.assistant.tvts.HiTest:
Error in testHiResponse(com.google.android.assistant.tvts.HiTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HiTest.testHiResponse(HiTest.java:33)


Time: 64.812
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HiTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HiTest.testHiResponse(HiTest.java:33)

FAILURES!!!
Tests run: 1,  Failures: 1



05-13 19:46:27 D/RunUtil: Running command null without timeout.
05-13 19:46:27 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:46:27 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:46:27 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:46:28 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:46:28 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:46:28 D/RunUtil: Running command null without timeout.
05-13 19:46:28 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:46:28 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:46:28 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:46:28 D/RunUtil: Running command null without timeout.
05-13 19:46:28 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:46:28 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:46:29 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.katniss
05-13 19:46:29 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.katniss] with timeout: 2m 0s
05-13 19:46:29 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:46:29 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:46:29 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:46:29 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:46:30 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, getprop, ro.config.low_ram] with timeout: 45s
05-13 19:46:30 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, pm, list, features] with timeout: 2m 0s
05-13 19:46:30 W/TestDevice: Feature: feature:com.google.android.feature.AMATI_EXPERIENCE is not available on SKBFXYZO0C1V
05-13 19:46:30 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, getprop, ro.config.low_ram] with timeout: 45s
05-13 19:46:30 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, pm, list, features] with timeout: 2m 0s
05-13 19:46:30 W/TestDevice: Feature: feature:com.google.android.feature.AMATI_EXPERIENCE is not available on SKBFXYZO0C1V
05-13 19:46:30 I/BasicAggregationTypeBase: Checking if collection is initialized with data
05-13 19:46:30 I/BasicAggregationTypeBase: Checking if collection has invalid values
05-13 19:46:30 I/BasicAggregationTypeBase: Checking if collection is initialized with data
05-13 19:46:30 I/BasicAggregationTypeBase: Checking if collection has invalid values
05-13 19:46:30 I/BasicAggregationTypeBase: Checking if collection is initialized with data
05-13 19:46:30 I/BasicAggregationTypeBase: Checking if collection has invalid values
05-13 19:46:30 I/BasicAggregationTypeBase: Checking if collection is initialized with data
05-13 19:46:30 I/BasicAggregationTypeBase: Checking if collection has invalid values
05-13 19:46:30 D/PrettyTestEventLogger: 
==================== com.google.android.assistant.v4.tvts.TvtsAssistant4Test#testNormalDeviceUsage ENDED: Mon May 13 19:46:30 KST 2024 ====================
